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(54) Recording medium having video data stored therein which is capable of forcibly 

reproducing sub-picture in accordance with state of reproduction and system for the same 



(57) A recording medium (10) is provided in which 
video data capable of forcibly reproducing a sub-picture 
in accordance with a state of reproduction is stored. 
A sub-picture pack sequence (85) for forming a sub-pic- 
ture data unit (230) stores a unit header, run-length- 
compressed sub-picture pixel data (232) and a display 

230 



sequence table (233). The display sequence table (233) 
stores a plurality of display sequences (234) and hav- 
ing, described therein, a command for forcibly output- 
ting sub-picture pixel data as the display sequence 
(234). 
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Description 

The present invention relates to a recording 
medium having, together with video data, sub-picture 
data stored therein and a reproducing system for the s 
same, and more particularly to a recording medium hav- 
ing video data stored therein which is capable of forcibly 
reproducing sub-picture in accordance with a state of 
reproduction and a reproducing system for the same. 

Recently, a significant progress has been achieved 10 
in developing an optical disk reproducing apparatus 
adaptable to time-varying images. 

The apparatus of the foregoing type is arranged 
such that data is reproduced from an optical disk which 
is a recording medium, on which digital data of, images, is 
audio and the like, has been compressed and recorded 
at a high density and a monitor or a speaker unit is oper- 
ated in accordance with reproduced digital data. If opti- 
cal disk reproducing apparatuses of the foregoing type 
will be mass-produced in the future, a multiplicity of 20 
manufacturers are expected to provide a variety of soft- 
ware of motion pictures, those of singing to taped 
accompaniment and the like. 

Hitherto, video tapes have been employed as usual 
image recording mediums. The video tape having a 25 
smaller recording capacity per unit area than that of the 
optical disk does not permit a complicated random 
access. Therefore, video data is usually recorded 
together with audio data such that video data is, as an 
option, recorded together with single sub-picture data. 30 
Audio data and sub-picture data are selectively repro- 
duced by a conventional reproducing system. Since 
state and time of reproduction of sub-picture data are 
not controlled, sub-pictures provided for respective 
scenes cannot be switched. 35 

Video recording mediums having English captions 
have been widely used in U.S.A.. The English caption is 
recorded on the recording medium as a form of sub-pic- 
ture data. Then, a system for reproducing the foregoing 
recording medium selectively turns on or off the English 40 
caption. If the English caption is turned off, the repro- 
ducing system continuously disables the display of the 
English caption regardless of a speech expressed by 
audio data which is reproduced together with sub-pic- 
ture data. 45 

If a recording medium stores a movie containing a 
scene in which a speech in a language except for Eng- 
lish is expressed, there arises the following problem. If 
the English caption of the reproducing apparatus is 
turned off, any English caption is not displayed even in so 
a case where a speech in another language is output. 
Specifically, a corresponding scene can be considered 
in which a hero travels from an English language zone 
to a French language and thus the hero speaks French. 
If no English caption corresponding to the French ss 
speech is displayed, audiences in the English language 
zone cannot understand the foregoing speech. Simi- 
larly, a corresponding scene can be considered in which 
a hero looks at a label of a medicine written in German. 



If no English caption indicating the label written in Ger- 
man is displayed, audiences in the English language 
zone cannot understand the type of the medicine. 

The above-mentioned problem can be solved by 
preparing an additional English caption which is turned 
on when the main English caption has been turned off 
and which relates to a speech in a language except for 
English. In this case, a recording space having a capac- 
ity of two times is required to record sub-picture data for 
the main English caption and sub-picture data for the 
additional English caption. 

A first object of the present invention is to provide a 
recording medium in which video data capable of forci- 
bly reproducing a sub-picture in accordance with a state 
of reproduction is stored. 

A second object of the present invention is to pro- 
vide a reproducing system for causing a sub-picture to 
be adequately displayed in accordance with a state of 
reproduction from a recording medium, in which video 
data capable of forcibly reproducing the sub-picture is 
stored. 

A third object of the present invention is to provide 
a reproducing method of causing a sub-picture to be 
adequately displayed in accordance with a state of 
reproduction from a recording medium, in which video 
data capable of forcibly reproducing the sub-picture is 
stored. 

A fourth object of the present invention is to provide 
a method of recording sub-picture data together with 
video data on a recording medium, in which video data 
capable of forcibly reproducing a sub-picture in accord- 
ance with a state of reproduction is stored. 

A fifth object of the present invention is to provide 
an apparatus for recording sub-picture data together 
with video data on a recording medium, in which video 
data capable of forcibly reproducing a sub-picture in 
accordance with a state of reproduction is stored. 

A sixth object of the present invention is to provide 
a communication system for transferring, together with 
sub-picture data, video data capable of forcibly repro- 
ducing a sub-picture in accordance with a state of repro- 
duction. 

According to one aspect of the present invention, 
there is provided a recording medium having a data 
pack sequence composed of recorded packs in each of 
which video data, audio data and sub-picture data 
respectively are stored, the recording medium compris- 
ing: 

a sub-picture data unit composed of a plurality of 
sub-picture packs, wherein 

control information for controlling reproduction of 
sub-picture data is described in the sub-picture 
data unit. 

According to another aspect of the present inven- 
tion, there is provided a reproducing method structured 
such that a sub-picture is reproduced from a recording 
medium having a data pack sequence composed of 
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recorded packs in each of which video data, audio data 
and sub-picture data respectively are stored, the repro- 
ducing method comprising the steps of: 



According to another aspect of the present inven- 
tion, there is provided a reproducing apparatus for is 
reproducing a sub-picture from a recording medium 
having a data pack sequence composed of recorded 
packs in each of which video data, audio data and sub- 
picture data respectively are stored, the reproducing 
apparatus comprising: 20 

means for retrieving a sub-picture data unit com- 
posed of a plurality of sub-picture packs from the 
recording medium; and 

means for retrieving control information for control- 25 
ling reproduction of sub-picture data described in 
the sub-picture data unit to control output of pixel 
data in the sub-picture data unit in accordance with 
retrieved control information. 

30 

According to another aspect of the present inven- 
tion, there is provided a recording method structured 
such that a data pack sequence consisting of packs in 
each of which video data, audio data and sub-picture 
data respectively are stored is recorded on a recording 35 
medium, the recording method comprising the steps of: 

forming a sub-picture data unit by a plurality of sub- 
picture packs; and 

describing control information for controlling repro- 40 
duction of sub-picture data in the sub-picture data 
unit. 

According to another aspect of the present inven- 
tion, there is provided a recording apparatus for record- 45 
ing, on a recording medium, a data pack sequence 
consisting of packs in each of which video data, audio 
data and sub-picture data respectively are stored, the 
recording apparatus comprising: 

50 

means for forming a sub-picture data unit by a plu- 
rality of sub-picture packs; and 
means for describing control information for control- 
ling reproduction of sub-picture data in the sub-pic- 
ture data unit. 55 

According to another aspect of the present inven- 
tion, there is provided a communication apparatus for 
transferring a data pack sequence consisting of packs 



respectively storing video data, audio data and sub-pic- 
ture data, the communication apparatus comprising: 

means for transferring, to the recording medium, a 
sub-picture data unit composed of a plurality of sub- 
picture packs, the means being transferring means 
for transferring control information for controlling 
reproduction of sub-picture data to be described in 
the sub-picture data unit and controlling output of 
pixel data in the sub-picture data unit in accordance 
with transferred control information. 

This invention can be more fully understood from 
the following detailed description when taken in con- 
junction with the accompanying drawings, in which: 

FIG. 1 is a block diagram schematically showing an 
optical disk apparatus; 

FIG. 2 is a block diagram showing details of the 
mechanism of a disk drive section shown in FIG. 1 ; 
FIG. 3 is a perspective view schematically showing 
the structure of an optical disk shown in FIG. 1 ; 
FIG. 4 shows a structure of a logic format of an opti- 
cal disk shown in FIG. 3; 

FIG. 5 shows a structure of a video manager shown 
in FIG. 4; 

FIG. 6 shows a structure of a video object set 
(VOBS) shown in FIG. 5; 

FIG. 7 shows parameters and contents of a volume 
manager information management table 
(VMGIJvlAT) in the video manager (VMGI) shown 
in FIG. 6; 

FIG. 8 shows a structure of a title search pointer 
table (TSPT) in the video manager (VMGI) shown 
in FIG. 6; 

FIG. 9 shows parameters and contents of title 
search pointer table information (TSPTI) of the title 
search pointer table (TSPT) shown in FIG. 8; 
FIG. 10 shows parameters and contents of a title 
search pointer (TT_SRP) corresponding to an input 
number of the title search pointer table (TSPT) 
shown in FIG. 8; 

FIG. 1 1 is a view for describing the structure of a 
program chain stored in the file; 
FIG. 12 shows a structure of a video manager 
menu PGCI unit table (VMGM_PGCI_UT) shown in 
FIG. 8; 

FIG. 13 shows parameters and contents of 
VMGM_PGCI unit table information shown in FIG. 
12; 

FIG. 14 shows parameters and contents of a video 
manager menu language unit search pointer shown 
in FIG. 12; 

FIG. 15 shows a structure of a video manager 
menu language unit shown in FIG. 12; 
FIG. 16 shows parameters and contents of video 
manager menu language unit information shown in 
FIG. 15; 

FIG. 1 7 shows parameters and contents of video 



acquiring a sub-picture data unit composed of a s 
plurality of sub-picture packs from the recording 
medium; and 

acquiring control information for controlling repro- 
duction of sub-picture data described in the sub- 
picture data unit to control output of pixel data in the 10 
sub-picture data unit in accordance with acquired 
control information. 
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manager menu program chain information shown in 
FIG. 15; 

FIG. 18 shows a structure of a video title set 

attribute table shown in FIG. 5; 

FIG. 19 shows parameters and contents of video 

title set attribute table information shown in FIG. 18; 

FIG. 20 shows parameters and contents of a video 

title set attribute search pointer shown in FIG. 18; 

FIG. 21 shows parameters and contents of video 

title set attribute shown in FIG. 18; 

FIG. 22 shows a structure of a video title set shown 

in FIG. 4; 

FIG. 23 shows parameters and contents of a man- 
agement table (VTSI_MAT) of video title set infor- 
mation (VTSI) shown in FIG. 22; 
FIG. 24 shows a structure of a video title set part of 
title search pointer table (VTS_PTT_SRPT) shown 
in FIG. 22; 

FIG. 25 shows parameters and contents of part of 
title search pointer information (PTT_SRPTI) 
shown in FIG. 24; 

FIG. 26 shows parameters and contents of a title 
unit search pointer (TTU_SRP) shown in FIG. 24; 
FIG. 27 shows parameters and contents of a part of 
title search pointer (PTT_SRP) shown in FIG. 24; 
FIG. 28 shows a structure of a table (VTS_PGCIT) 
of video title set program chain information shown 
in FIG. 22; 

FIG. 29 shows parameters and contents of informa- 
tion (VTS_PGCITI) of a table (VTS_PGCIT) of 
video title set program chain information shown in 
FIG. 28; 

FIG. 30 shows parameters and contents of a 
search pointer (VTS_PGCIT_SRP) of the table 
(VTS_PGCIT) of the video title set program chain 
information shown in FIG. 28; 
FIG. 31 shows a structure of program chain infor- 
mation (VTS_PGCI) for video title set correspond- 
ing to the program chain of video title set program 
chain information (VTS_PGCI) shown in FIG. 28; 
FIG. 32 shows parameters and contents of general 
information (PGC_GI) of a program chain of pro- 
gram chain information (VTS_PGCI) shown FIG. 
31; 

FIG. 33 shows a structure of a program chain map 

(PGC_PGMAP) of program chain information 

(VTS_PGCI) shown in FIG. 31; 

FIG. 34 shows parameters and contents of an entry 

cell number (ECELLN) of a program described on a 

program chain map (PGC_PGMAP) shown in FIG. 

33; 

FIG. 35 shows a structure of a cell playback infor- 
mation table (C_PBIT) of program chain information 
(VTS_PGCI) shown in FIG. 33; 
FIG. 36 shows parameters and contents of cell 
playback information (C_PBI) on the cell playback 
information table (C_PBIT) shown in FIG. 35; 
FIG. 37 shows a structure of cell position informa- 
tion (C_POSI) of program chain information 



(VTS_PGCI) shown in FIG. 35; 

FIG. 38 shows parameters and contents of the cell 
position information (C_POSI) shown in FIG. 37; 
FIG. 39 shows a structure of a video title set menu 
5 PGC unit table shown in FIG. 22; 

FIG. 40 shows parameters and contents of video 
title set PGCI unit table information shown in FIG. 
39; 

FIG. 41 shows parameters and contents of a video 

10 title set language search pointer shown in FIG. 39; 
FIG. 42 shows a structure of a video title set menu 
language unit shown in FIG. 39; 
FIG. 43 shows parameters and contents of video 
title set menu language unit information shown in 

15 FIG. 42; 

FIG. 44 shows parameters and contents of a video 
title set PGCI search pointer shown in FIG. 42; 
FIG. 45 shows a structure of a navigation pack 
shown in FIG. 6; 

20 FIG. 46 shows a structure of a video, audio or sub- 
picture pack shown in FIG. 6; 
FIG. 47 shows parameters and contents of presen- 
tation control information (PCI) of the navigation 
pack shown in FIG. 45; 

25 FIG. 48 shows parameters and contents of general 
information (PCIJ3I) in presentation control infor- 
mation (PCI) shown in FIG. 45; 
FIG. 49 shows parameters and contents of disk 
search information (DSI) of the navigation pack 

30 shown in FIG. 48; 

FIG. 50 shows parameters and contents of DSI 
general information (DSLGI) of disk search infor- 
mation (DSI) shown in FIG. 49; 
FIG. 51 shows parameters and contents of syn- 

35 chronous playback information (SYNCI) of video 
object (VOB) shown in FIG. 49; 
FIG. 52 shows the relationship between a sub-pic- 
ture pack and the sub-picture data unit (SPU) 
shown in FIG. 6; 

40 FIG. 53 shows the structure of data in the sub-pic- 
ture data unit (SPU) shown in FIG. 52; 
FIG. 54 shows parameters and contents of unit 
headers (SPUH) of the sub-picture data units 
shown in FIG. 53; 

45 FIG. 55 shows parameters and contents in a dis- 
play sequence control table (SP_DCSQT) of the 
sub-picture data unit (SPU) shown in FIG. 53; 
FIG. 56 shows command names and contents of 
the display control commands (SP_DCSQT) shown 

so in FIG. 55; 

FIG. 57 is a block diagram showing the structure of 
a circuit in the sub-picture decoder 62 shown in 
FIG. 1 ; 

FIG. 58 shows an operation flow from the start of 
55 the operation of the apparatus to the acquisition of 
the video title set; 

FIG. 59 is a flow chart illustrating a video manager 
menu search operation; 

FIG. 60 is a flow chart illustrating a video title set 
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menu search operation; 

FIG. 61 is flow chart illustrating a procedure for 
acquiring a video title set and reproducing a PGC; 
FIG. 62 is a flow chart of a reproducing process of 
the sub-picture data unit; 

FIG. 63A and FIG. 63 B are an another flow chart of 
a reproducing process of the sub-picture data unit; 
FIG. 64 is a block diagram illustrating an encoder 
system for encoding video data and generating a 
video file; 

FIG. 65 is a flow chart illustrating an encoding proc- 
ess in the encoder system shown in FIG. 64; 
FIG. 66 is a flow chart illustrating a process of form- 
ing a video data file by combining video data, audio 
data and sub-picture data encoded by the flow of 
FIG. 65; 

FIG. 67 is a block diagram showing a disk formatter 
system for recording a formatted video file on the 
optical disk; 

FIG. 68 is a flow chart for producing logic data to be 
recorded on the disk, in the disk formatter shown in 
FIG. 67; 

FIG. 69 is a flow chart for producing, from the logic 
data, physical data to be recorded on the disk; and 
FIG. 70 schematically shows a system for transfer- 
ring the video title set shown in FIG. 22 through a 
communication system. 

Hereinafter, referring to the accompanying draw- 
ings, an optical disk and an optical disk reproducing 
apparatus according to an embodiment of the present 
invention will be explained. 

FIG. 1 is a block diagram of an optical disk repro- 
ducing apparatus that reproduces data from an optical 
disk associated with the embodiment of the present 
invention. FIG. 2 is a block diagramof a disk drive sec- 
tion that drives the optical disk shown in FIG. 1. FIG. 3 
shows the structure of the optical disk shown in FIGS. 1 
and 2. 

As shown in FIG. 1 , the optical disk reproducing 
apparatus comprises a key/display section 4, a monitor 
section 6, and a speaker section 8. When the user oper- 
ates the key/display section 4, this causes the recorded 
data to be reproduced from an optical disk 10. The 
recorded data contains video data, sub-picture data, 
and audio data, which are converted into video signals 
and audio signals. The monitor section 6 displays 
images according to the audio signals and the speaker 
section 8 generates sound according to the audio sig- 
nals. 

It is known that the optical disk 10 is available with 
various structures. For instance, one type of the optical 
disk 10 is a read-only disk on which data is recorded 
with a high density as shown in FIG. 3. The optical disk 
10, as shown in FIG. 3. is made up of a pair of compos- 
ite layers 18 and an adhesive layer 20 sandwiched 
between the composite disk layers 18. Each of the com- 
posite disk layers 18 is composed of a transparent sub- 
strate 14 and a recording layer or a light-reflecting layer 



1 6. The disk layer 1 8 is arranged so that the light-reflect- 
ing layer 16 may be in contact with the surface of the 
adhesive layer 20. A center hole 22 is made in the opti- 
cal disk 10. On the periphery of the center hole 22 on 

5 both sides, clamping areas 24 are provided which are 
used to clamp the optical disk 10 during its rotation. 
When the disk 1 0 is loaded in the optical disk apparatus, 
the spindle of a spindle motor 12 shown in FIG. 2 is 
inserted into the center hole 22. As long as the disk is 

io being rotated, it continues clamped at the clamping 
areas 24. 

As shown in FIG. 3, the optical disk 10 has an infor- 
mation zone 25 around the clamping zone 24 on each 
side, the information zones allowing the information to 

is be recorded on the optical disk 10. In each information 
area 25, its outer circumference area is determined to 
be a lead-out area 26 in which no information is nor- 
mally recorded, its inner circumference area adjoining 
the clamping area 24 is determined to be a lead-in area 

20 27 in which no information is normally recorded, and the 
area between the lead-out area 26 and the lead-in area 
27 is determined to be a data recording area 28. 

At the recording layer 16 in the information area 25, 
a continuous spiral track is normally formed as an area 

25 in which data is to be recorded. The continuous track is 
divided into a plurality of physical sectors, which are 
assigned serial numbers. On the basis of the sectors, 
data is recorded. The data recording area 28 in the 
information recording area 25 is an actual data record- 

30 ing area, in which reproduction data, video data, sub- 
picture data, and audio data are recorded in the form of 
pits (that is, in the form of changes in the physical state), 
as will be explained later. With the read-only optical disk 
10, a train of pits is formed in advance in the transparent 

35 substrate 1 4 by a stamper, a reflecting layer is formed 
by deposition on the surface of the transparent sub- 
strate 14 in which the pit train is formed, and the reflect- 
ing layer serves as the recording layer 16. In the read- 
only optical disk 10, a groove is normally not provided 

40 as a track and the pit train in the surface of the transpar- 
ent substrate 14 serves as a track. 

The optical disk apparatus 12, as shown in FIG. 1, 
further comprises a disk drive section 30, a system CPU 
section 50, a system ROM/RAM section 52, a system 

45 processor section 54, a data RAM section 56, a video 
decoder section 58, an audio decoder section 60, a sub- 
picture decoder section 62, and a D/A and data repro- 
ducing section 64. 

As shown in FIG. 2, the disk drive section 30 con- 
so tains a motor driving circuit 1 1, a spindle motor 12, an 
optical head 32 (i.e.. an optical pickup), a feed motor 33, 
a focus circuit 36, a feed motor driving circuit 37, a track- 
ing circuit 38, a head amplifier 40, and a servo process- 
ing circuit 44. The optical disk 10 is placed on the 

55 spindle motor 12 driven by the motor driving circuit 1 1 
and is rotated by the spindle motor 1 2. The optical head 
32 that projects a laser beam on the optical disk 10 is 
located under the optical disk 10. The optical head 32 is 
placed on a guide mechanism (not shown). The feed 
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motor driving circuit 37 is provided to supply a driving 
signal to the feed motor 33. The motor 33 is driven by 
the driving signal and moves in and out the optical head 
32 across the radius of the optical disk 10. The optical 
head 32 is provided with an objective lens 34 positioned 5 
so as to face the optical disk 1 0. The objective lens 34 is 
moved according to the driving signal supplied from the 
focus circuit 36 so as to move along its optical axis. 

To reproduce the data from the above optical disk 
10, the optical head 32 projects a laser beam on the 10 
optical disk 10 via the objective lens 34. The objective 
lens 34 is moved little by little across the radius of the 
optical disk 10 according to the driving signal supplied 
from the tracking circuit 38. Furthermore, the objective 
lens 34 is moved along its optical axis according to the 15 
driving signal supplied from the focusing circuit 36 so 
that its focal point may be positioned on the recording 
layer 16 of the optical disk 10. This causes the laser 
beam to form the smallest beam spot on the spiral track 
(i.e.. the pit train), enabling the beam spot to trace the 20 
track. The laser beam is reflected from the recording 
layer 16 and returned to the optical head 32. The optical 
head 32 converts the beam reflected from the optical 
disk 10 into an electric signal, which is supplied from the 
optical head 32 to the servo processing circuit 44 via the 25 
head amplifier 40. From the electric signal, the servo 
processing circuit 44 produces a focus signal, a tracking 
signal, and a motor control signal and supplies these 
signals to the focus circuit 36, tracking circuit 38, and 
motor driving circuit 1 1 , respectively. 30 

Therefore, the objective lens 34 is moved along its 
optical axis and across the radius of the optical disk 10, 
its focal point is positioned on the recording layer 16 of 
the optical disk 10, and the laser beam forms the small- 
est beam spot on the spiral track Furthermore, the spin- 35 
die motor 12 is rotated by the motor driving circuit 1 1 at 
a specific rotating speed. This allows the beam to track, 
for example, at a constant linear speed. 

The system CPU section 50 of FIG. 1 supplies to 
the servo processing circuit 44 a control signal serving 40 
as an access signal. In response to the control signal, 
the servo processing circuit 44 supplies a head-moving 
signal to the feed motor driving circuit 37, which sup- 
plies a driving signal to the feed motor 33. Then, the 
feed motor 33 is driven, causing the optical head 32 to 45 
move across the radius of the optical disk 10. Then, the 
optical head 32 accesses a specific sector formed at the 
recording layer 16 of the optical disk 10. The data is 
reproduced from the specific sector by the optical head 
32, which then supplies it to the head amplifier 40. The so 
head amplifier 40 amplifies the reproduced data, which 
is outputted at the disk drive section 30. 

The reproduced data is transferred and stored in 
the data RAM section 56 by the system processor sec- 
tion 54 which is controlled by the system CPU section 55 
50 which is operated in accordance with the programs 
stored in the system ROM/RAM section 52. The stored 
reproduced data is processed at the system processor 
section 54, which sorts the data into video data, audio 



m 

data, and sub-picture data, which are supplied to the 
video decoder section 58, audio decoder section 60, 
and sub-picture decoder section 62, respectively, and 
are decoded at the respective decoders. The D/A and 
data-reproducing section 64 converts the decoded 
video data, audio data, and sub-picture data into an 
analog video signal and an analog audio signal, and 
supplies the resulting video signal to the monitor 6 and 
the resulting audio signal to the speaker 8. Then, on the 
basis of the video signal and sub-picture signal, images 
are displayed on the monitor section 6 and according to 
the audio signal, sound is simultaneously reproduced at 
the speaker section 8. 

The operation of the optical disk apparatus shown 
in FIG. 1 will be described in greater detail along with 
the logic formats of the optical disk 10. 

FIG. 4 shows the structure of the theoretical format 
f a optical disk 10 shown in FIG. 1. The data recording 
area 28 between the lead-in area 27 and the lead-out 
area 26 on the optical disk 10 of FIG. 1 has a volume 
and file structure as shown in FIG. 4. The structure has 
been determined in conformity to specific logic format 
standards, such as micro UDF or ISO 9660. The data 
recording area 28 is physically divided into a plurality of 
sectors as described earlier. These physical sectors are 
assigned serial numbers. In the following explanation, a 
logical address means a logical sector number (LSN) as 
determined in micro UDF or ISO 9660. Like a physical 
sector, a logical sector contains 2048 bytes. The num- 
bers (LSN) of logical sectors are assigned consecu- 
tively in ascending order as the physical sector number 
increments. 

As shown in FIG. 4, the volume and file structure is 
a hierarchical structure and contains a volume and file 
structure area 100, a video manager (VMG) 101, at 
least one video title set (VTS) 1 02, and other recorded 
areas 73. These areas are partitioned at the boundaries 
between logical sectors. As with a conventional CD, a 
logical sector is defined as a set of 2048 bytes. Similarly, 
a logical block is defined as a set of 2048 bytes. There- 
fore, a single logical sector is defined as a single logical 
block. 

The file structure area 100 corresponds to a man- 
agement area determined in micro UDF or ISO 9660. 
According to the description in the management area, 
the video manager 101 is stored in the system 
ROM/RAM section 52. As explained with reference to 
FIG. 5, the information used to manage video title sets 
is described in the video manager, which is composed 
of a plurality of files 104, starting with file #0. In each 
video title set (VTS) 102, compressed video data, com- 
pressed audio data, compressed sub-picture data, and 
the playback information about these data items are 
stored as explained later. Each video title set is com- 
posed of a plurality of files 104. The number of video 
title sets is limited to 99 maximum. Furthermore, the 
number of files 104 (from File #j to File #j+12) constitut- 
ing each video title set is 12 at most. These files are also 
partitioned at the boundaries between logical sectors. 
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In the other recorded areas 73, the information 
capable of using the video title sets 102 is recorded. 
The other recorded areas 103 are not necessarily pro- 
vided. 

As shown in FIG. 5. the video manager 101 con- 
tains at least three items each corresponding to individ- 
ual files 104. Specifically, the video manager 101 is 
made up of video manager information (VMGI) 105, a 
video object set (VMGM_VOBS) 106 for video manager 
menu, and backup (VMGI_BUP) 107 of video manager 
information. Here, the volume manager information 
(VMGI) 105 and the backup (VMGI_BUP) 107 of video 
manager information are determined to be indispensa- 
ble items, and the video object set (VMGM_VOBS) 106 
for video manager menu is determined to be an optional 
item. In the video object set (VMGM-VOBS) 106 for 
VMGM, the video data, audio data, and sub-picture data 
for a menu of the volumes of the optical disk managed 
by the video manager 101 are stored. 

As in the case of video reproduction which will be 
explained later, the volume name of the optical disk and 
the explanation of the audio and sub-picture accompa- 
nied by the display of the volume name are displayed by 
the video object set (VMGM_VOBS) 1 06 for VMGM, 
and selectable items are displayed by the sub-picture. If 
video data of all matches a boxer X had fought until he 
won the world championship is reproduced by the video 
object set (VMGM_VOBS) 106, the fighting pose of 
Boxer X will be displayed along with the volume name 
showing his glorious fighting history, the theme song for 
him will be generated, and his fighting history will be dis- 
played by the sub-picture. Further, questions are made 
to the user as to in which language (English or Japa- 
nese) the narration should be presented, and as to in 
which other language the subtitle should be presented 
by the sub-picture. Thus, the video object set 
(VMGM_VOBS) 106 for VMGM enables the user to 
enjoy seeing any match Boxer X has fought, while listing 
to the narration in, for example, English and reading the 
subtitle in, for example, Japanese. 

The structure of a video object set (VOBS) 82 will 
be described with reference to FIG. 6. FIG. 6 shows an 
example of a video object set (VOBS) 82. The video 
object set (VOBS) 82 is provided in three types 106, 141 
and 142 for two menus and a title. Specifically, in the 
video object set (VOBS) 82, a video title set (VTS) 102 
contains a video object set (VTSM_VOBS) 82 for a 
menu of video title sets and a video object set 
(VTSTT_VOBS) 142 for the titles of at least one video 
title set, as will be explained later. Each video object 82 
set has the same structure except that their uses differ. 

As shown in FIG. 6, a video object set (VOBS) 82 is 
defined as a set of one or more video objects (VOB) 83. 
The video objects 83 in a video object set (VOBS) 82 
are used for the same application. A video object set 
(VOBS) 83 for menus is usually made up of a single 
video object (VOB) 83 and stores the data used to dis- 
play a plurality of menu screens. In contrast, a video 
object set (VTSTT_VOBS) 82 for title sets is usually 



composed of a plurality of video objects (VOB) 83. 

Taking the boxing match as example, a video object 
(VOB) 83 corresponds to the video data of each match 
played by Boxer X. Specifying a particular video object 

5 (VOB) enables, for example, Boxer X's eleventh match 
for a world championship to be reproduced on a video. 
The video object set (VTSM_VOBS) 82 for a menu of 
the video title sets 102 contains the menu data for the 
matches played by boxer X. According to the preserrta- 

10 tion of the menu, a particular match, for example, Boxer 
X's eleventh match for a world championship, can be 
specified. In the case of a usual single story movie, one 
video object (VOB) 83 corresponds to one video object 
set (VOBS) 82. One video stream is completed with one 

is video object set (VOBS) 82. In the case of a collection 
of animated cartoons or an omnibus movie, a plurality of 
video streams each corresponding to individual stories 
are provided in a single video object set (VOBS) 82. 
Each video stream is stored in the corresponding video 

20 object. Accordingly, the audio stream and sub-picture 
stream related to the video stream are also completed 
with each video object (VOB) 83. 

An identification number (IDNJ#j) is assigned to a 
video object (VOB) 83. By the identification number, the 

25 video object (VOB) 83 can be identified. A single video 
object (VOB) 83 is made up of one or more cells 84. 
Although a usual video stream is made up of a plurality 
of cells, a menu video stream, or a video object (VOB) 
83 may be composed of one cell 84. A cell is likewise 

30 assigned an identification number (C_IDN#j). By the 
identification number (C_IDN#j), the cell 84 is identified. 

As shown in FIG. 6 ( each cell 84 is composed of 
one or more video object units (VOBU) 85, usually a plu- 
rality of video object units (VOBU) 85. A video object 

35 unit (VOBU) 85 is defined as a pack train having a single 
navigation pack (NAV pack) 86 at its head. Specifically, 
a video object unit (VOBU) 85 is defined as a set of all 
the packs recorded, starting at a navigation pack (NAV 
pack) to immediately in front of the next navigation pack. 

40 The playback time of the video object unit (VOBU) cor- 
responds to the playback time of the video data made 
up of one or more GOPs (Group of Pictures) contained 
in the video object (VOBU). The playback time is set at 
0.4 seconds or more second and less than one second. 

45 In the MPEG standard, a single GOP is set at, usually, 
0.5 seconds; it is compressed screen data for reproduc- 
ing about 15 screens during that period. 

When a video object unit includes video data as 
shown in FIG. 6, more than one GOP composed of 

so video packs (V packs) 88, a sub-picture pack (SP pack) 
90, and an audio pack (A pack) 91 all determined in the 
MPEG standard, are arranged to produce a video data 
stream. Regardless of the number of GOPs, a video 
object unit (VOBU) 85 is determined on the basis of the 

55 playback time of a GOP. The video object always has a 
navigation pack (NV pack) 86 at its head. Even when 
the playback data consists only of audio and/or sub-pic- 
ture data, it will be constructed using the video object 
unit as a unit. Specifically, even if a video object unit is 
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constructed only of audio packs, the audio packs to be 
reproduced within the playback time of the video object 
unit to which the audio data belongs will be stored in the 
video object unit, as with the video object of video data. 

The video manager 101 will be explained with refer- s 
ence to FIG. 5. The video management information 105 
placed at the head of the video manager 101 contains 
information on the video manager itself, the information 
used to search for titles, the information used to repro- 
duce the video manager menu, and the information 10 
used to manage the video title sets (VTS) 102 such as 
the attribute information on video titles. The volume 
management information contains four tables 108, 109, 
111, and 110 in the order shown in FIG. 27. Each of 
these tables 1 08, 1 09, 111, and 1 10 is aligned with the 15 
boundaries between logical sectors. A first table, a 
video manger information management table 
(VMGI_MAT) 108, is a mandatory table. Written in the 
first table are the size of the video manager 101, the 
start address of each piece of the information in the 20 
video manger 101, and the start address of and the 
attribute information about the video object set 
(VMGM_VOBS) 106 for a video manager menu. As 
explained later, the attribute information includes the 
video attribute information, the audio attribute informa- 25 
tion, and the sub-picture attribute information. Accord- 
ing to these pieces of attribute information, the modes of 
the decoders 58, 60 and 62 are changed, thereby ena- 
bling the video object set (VMGM_VOBS) 106 to be 
reproduced in a suitable mode. 30 

Written in a second table of the video manager 101 , 
i.e., a title search pointer table (TT_SRPT) 109, are the 
start addresses of the video titles stored on the optical 
disk 10 that are selectable according to a title number 
entered from the key/display section 4 on the apparatus. 35 

A video manager menu PGCI unit table 
(VMGM_PGCI_UT) 1 10 which is a third table of a video 
manager 101 is an essential factor if a video object 
(VMGM_VOB) 106 for a video manager menu is pro- 
vided. The video object CVMGM_VOB) 1 06 for the video 40 
manager menu includes program chains corresponding 
to various languages and has described information 
relating to the program chains for the menu correspond- 
ing to the respective languages. 

Described in a fourth table of the video manager 45 
101 are a video title set attribution table (VTS_ATRT) 
111, the attribute information determined in the video 
title set (VTS) 102 in the volumes of the optical disk. 
Specifically, in this table, the following items are 
described is attribute information such as the number of so 
video title sets (VTS) 102, video title set (VTS) 102 num- 
bers, video attributes, such as a video data compres- 
sion scheme, audio stream attributes, such as an audio 
coding mode, and sub-picture attributes, such as the 
type of sub-picture display. 55 

The details of the contents of the video manage- 
ment information management table (VMGI_MAT) 108, 
video manager menu PGCI unit table 
(VMGM_PGCI_UT) 110 and title search pointer table 



(TT_SRPT) 109 will be described with reference to 
FIGS. 7 to 1 7. 

As shown in FIG. 7,-described in the video manage- 
ment information management table (VMGI_MAT) 108 
are an identifier (VMG_ID) for the video manager 101, 
the end address (VMG_EA) of the VMG with relative 
logical block number from the first logical block of the 
VMG and the end address (VMGI_EA) of the VMGI size 
with relative logical block number from the first logical 
block of the VMG, wherein one logical block is defined 
as 2048 bytes as described before, the version number 
(VERN) related to the standard for the optical disk, com- 
monly known as a digital versatile disk (digital multipur- 
pose disk, hereinafter, referred to as a DVD), and the 
category (VMG_CAT) of the video manger 101 . 

Described in the category (VMG_CAT) of the video 
manager 101 , a flag indicating whether or not the DVD 
video directory inhibits copying. Further described in the 
table (VMGI_MAT) 108 are a volume set identifier 
(VLMSJD), the number of video title sets (VTSJMs), 
the identifier for a provider supplying the data to be 
recorded on the disk (PVR_ID), the start address 
(VMGM_VOBS_SA) of the video object set 
(VMGM_VOBS) 106 for a video manager menu, the end 
address (VMGIJvlAT_EA) of a volume manager infor- 
mation management table (VMGLMAT) 108, and the 
start address (TT_SRPT_SA) of a title search pointer 
table (TT_SRPT) 109. If the video object set 
(VMGM_VOBS) 141 for the VMG menu is absent, 
"00000000h" will be described in its start address 
(VMGM_VOBS_SA). The end address 
(VMG l_MAT_E A) of VMG_MAT 108 is described by the 
number of bytes, relative to the head byte of VMGLMAT 
108. The start address (TT_SRPT_SA) of the TT-SRPT 
1 09 is described by the number of logical blocks, rela- 
tive to the head logical block of VMG1 1 05. 

Furthermore, in the table 108, the start address 
(VMGM_PGCI_UT_SA) of the video manager menu 
PGCI unit table (VMGM_PGCI_UT) and the start 
address ( VTS_AT RT_S A) of the attribute table 
(VTS_ATRT) of video title sets (VTS) 1 02 are repre- 
sented by the number of bytes, relative to the first byte 
in the VMGI manager table (VMGLMAT) 108. Also 
described in the table 108 is the video attribute 
(VMGM_V_ATR) of the video manager menu (VMGM) 
video object set 106. Further described in the table 108 
are the number (VMGM_AST_Ns) of audio streams in 
the video manager menu (VMGM), the attributes 
(VMGI_AST_ATR) of audio streams in the video man- 
ager menu (VMGM), the number (VMGM_SPST_Ns) of 
sub-picture streams in the video manager menu 
(VMGM), and the attributes (VMGM_SPST_ATR) of 
sub-picture streams in the video manager menu 
(VMGM). When the video manager menu (VMGM) is 
not present, "00000000h" is described in the video man- 
ager menu PGCI unit table (VMGM_PGCI_UT). 

Explanation of the structure shown in FIG. 5 will be 
resumed. In the title search pointer table (TT_SRPT) 
109 of FIG. 5, the title search pointer table information 
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(TSPTI) is first descried as shown in FIG. 8. Then, as 
many title search pointers (TT_SRP) for input numbers 
1 to n (n ^ 99) as are needed are described consecu- 
tively. When only the playback data for a single title, for 
example, only the video data for a single title, is stored 
in a volume of the optical disk, only a single title search 
pointer (TT_SRP) 121 is described in the table 
(TT_SRPT) 109. 

The title search pointer table information (TSPTI) 

120 contains the number (TT_SRP_Ns) of title search 
pointers (TT_SRPs) and the end address 
(TT_SRPT_EA) of the title search pointer (TT-SRP) 121 
as shown in FIG. 9. The address (TT_S RPT_E A) is rep- 
resented by the number of bytes, relative to the first byte 
in the title search pointer table (TT_SRPT) 109. As 
shown in FIG. 10, described in each title search pointer 
(TT_SRP) are: a title playback type (TT_PB_TY), 
number of angle (AGL_Ns), a video title set number 
(VTSN), the number of parts of title (TT_Ns), VTS title 
number (VTS_TTN) which is used to access the corre- 
sponding TTU in the VTS_PTT_SRP of the VTS which 
is indicated with VTSN, and the video start address 
(VTS_SA) of the video title set 102. 

The contents of the title search pointer (TT_SRP) 

121 specifies a video title set to be reproduced and a 
program chain (PGC) as well as a location in which the 
video title set 102 is to be stored. The start address 
(VTS_SA) of the video title set 102 is represented by the 
number of logical blocks in connection with the title set 
specified by the video title set number (VTSN). 

A program chain 87 is defined as a set of programs 
89 that reproduce the story of a title, as shown in FIG. 
11 . In the case of a program chain for a menu, still pic- 
ture programs or moving picture programs are repro- 
duced one after another to complete a menu for a single 
title. In the case of a program chain for a title set, a pro- 
gram chain corresponds to a chapter in a story consist- 
ing of programs and the movie of a single title is 
completed by reproducing program chains consecu- 
tively. As shown in FIG. 1 1 , each program 89 is defined 
as a set of aforementioned cells 84 arranged in the 
order in which they are to be reproduced. 

In the video manager menu PGCI unit table 
(VMGM_PGCI_UT) 125 shown in FIG. 5, video man- 
ager - menu PGCI unit table information 
(VMGM__PGCI_UTI) 180 is first described as shown in 
FIG. 12. Video manager menu language unit search 
pointers (VMGM_LU_SRP) 126 are successively 
described in the same numbers as the number n of lan- 
guages. And the video manager menu language unit 
(VMGM__LU) 52 searched for by the search pointer is 
described. In this case, it is supposed that the menu 
defined by the video manager menu language unit 
(VMGMJ.U) must contain only one PGC. 

In the video manager menu PGCI unit table infor- 
mation (VMGM_PGCIJJTI) 110, the number 
(VMGM_LU_Ns) of VMGM language units (VMGM_LU) 
and the end address (VMGM_PGCMJT_EA) of the 
VMGM_PGCI unit table (VMGM_PGCI_UT) 110 are 



described as shown in FIG. 13. In each of n video man- 
ager menu language unit search pointers 
(VMGM_LU_SRP) 126 prepared for respective lan- 
guages, the language code (VMGM_LCD) of the video 

5 manager menu and the start address (VMGM_LU_SA) 
of the language unit (VMGIVMJJ) of the video manager 
menu (VMGM) are described as shown in FIG. 14. The 
end address (VMGM_PGCI_UT_EA) 0 f the 
VMGM_PGCIJJT no and the start address 

10 (VMGM_LU_SA) of the VMGMJJJ 127 are described 
by use of the logical block number from the head byte of 
the VMGM_PGCI unit table (VMGM_PGCI_UT) 110. 

In each of n VMGM language units (VMGM_LU) 
127 prepared for the respective languages, the video 

is manager menu language unit information (VMGM_LUI) 
130 and VMGM_PGCI search pointers 
(VMGM_PGCI_SRP) 1 31 of a number corresponding to 
the number of menu program chains are provided as 
shown in FIG. 37, and VMGM_PGC information items 

20 (VMGM_PGCI) 132 searched for by the search pointer 
and corresponding in number to the program chains for 
menu are provided. 

In each language unit information (VMGM_LUI) 
130, the number (VMGM_PGCI SRP_Ns) of search 

25 pointers of VMGM_PGCI and the end address 
(VMGM_LUI_EA) of the language unit information 
(VMGMJJJ I) are described as shown in FIG. 16. Fur- 
ther, in each VMGM_PGCI search pointer 
(VMGM_PGCI_SRP), the VMGM_PGC category 

30 (VMGM_PGC_CAT) and the start address 
(VMGM_PGCI_SA) of VMGM_PGCI are described as 
shown in FIG. 17. The end address ( VMGM_LU l_E A) of 
VMGMJ.UI and the start address (VMGM_PGCI_SA) 
of VMGM_PGCI are described by use of the relative 

35 logical block number from the head byte of VMGMLU. 
As the VMGM_PGC category (VMGM_PGC_CAT), 
information indicating that the program chain is an entry 
program chain or title menu is described. 

As shown in FIG. 18, the video title set attribute 

40 table (VTS_ATRT) 111 describing the attribute informa- 
tion on the video title set (VTS) 102 (shown in FIG. 4) 
contains video title set attribute table information 
(VTS_ATRTI) 133, n video title set attribute search 
pointers (VTS_ATR_SRP) 134, and n video title set 

45 attributes (VTS_ATR) 135, which are arranged in that 
order. The video title set attribute table information 
(VTS_ATRTl) 133 contains information on the table 111. 
In the video title set attribute search pointers 
(VTS_ATR_SRP) 134, description is made in the order 

so corresponding to the title sets #1 to #n. Similarly, 
description is made of the pointers for searching for the 
video title set attributes (VTS_ATR) 135 written in the 
order corresponding to the title sets #1 to #n. Described 
in each of the video title set attributes (VTS_ATR) 1 35 is 

55 the attribute of the corresponding title set (VTS). 

More specifically, the video title set attribute infor- 
mation (VTS_ATRTI) 133 contains a parameter 
(VTS_Ns) for the number of video titles and a parameter 
(VTS_ATRT_EA) for the end address of the video title 
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set attribute table (VTS_ART) 135 as shown in FIG. 19. 
As shown in FIG. 20, in each video title set attribute 
search pointer (VTS_ATR_SRP) 134 there is described 
a parameter (VTS_ATR_SA) for the start address of the 
corresponding video title set attribute (VTS_ATR) 135. 5 
As shown in FIG. 21, the video title set attribute 
( VTS_ATR) 1 35 contains a parameter (VTS_ATR_EA) 
for the end address of the video title set attribute 
(VTS_ATR) 135, a parameter (VTS__CAT) for the cate- 
gory of the corresponding video title set, and a parame- 10 
ter (VTS_ATRI) for attribute information on the 
corresponding video title set. Because the attribute 
information on the video title set contains the same con- 
tents of the attribute information on the video title set 
described in the video title set information management 75 
table (VTS_MAT). 

The structure of the logic format of the video title set 
(VTS) 102 shown in FIG. 5 will be explained with refer- 
ence to FIG. 22. In each video title set (VTS) 102, four 
items 140, 141 , 142 and 143 are described in the order 20 
shown in FIG. 22. Each video title set (VTS) 102 is 
made up of one or more video titles having common 
attributes. The video title set information (VTSI) con- 
tains the management information on the video titles 
102, including information on playback of the video 2s 
object set 142, information on playback of the title set 
menu (VTSM), and attribute information on the video 
object sets 102. 

Each video title set (VTS) 102 includes the backup 
143 of the video title set information (VTSI) 140. 30 
Between the video title set information (VTSI) 140 and 
the backup (VTSI_BUP) 143 of the information, a video 
object set (VTSM_VOBS) 141 for video title set menus 
and a video object set (VTSTT_VOBS) 142 for video 
title set titles are arranged. Both video object sets 35 
(VTSM__VOBS and VTSTT_VOBS) 141 and 142 have 
the structure shown in FIG. 6, as explained earlier. 

The video title set information (VTSI) 140, the 
backup (VTSLBUP) 143 of the information , and the 
video object set (VTSTT_VOBS) 142 for video title set 40 
titles are items indispensable to the video title sets 102. 
The video object set (VTSM_VOBS) 141 for video title 
set menus is an option provided as the need arises. 

The video title set information (VTSI) 140 consists 
of seven tables 1 44, 1 45, 1 46, 1 47, 1 48, 1 49 and 1 50 as 45 
shown in FIG. 22. These seven tables 144, 145, 146, 
147, 148, 149 and 150 are forced to align with the 
boundaries between logical sectors. 

The video title set information management table 
(VTSI_MAT) 144, i.e., the first table, is a mandatory so 
table. Described in the table 108 are the size of the 
video title set (VTS) 1 02, the start address of each piece 
of information in the video title set (VTS) 102, and the 
attributes of the video object sets (VOBS) 82 in the 
video title set (VTS) 1 02. 55 

The video title set part-of-title search pointer table 
(VTS_PTT_SRPT) 145, which is the second table, is 
mandatory table. It is in this table that the selectable 
video titles, that is, program chain (PGC) or programs 



(PG) contained in the selectable video title set 102 are 
descried in accordance with the number that the user 
has entered from the key/display section 4. Entering the 
desired one of the entry numbers listed in the pamphlet 
coming with the optical disk 1 0 from the key/display sec- 
tion 4, the user can watch the video, starting with the 
section in the story corresponding to the entered 
number. 

The video title set program chain information table 
(VTS_PGCIT) 146, which is the third table, is a manda- 
tory table. Described in this table 146 is the VTS pro- 
gram chain information (VTS_PGCI) or information on 
VTS program chains. 

The video title set menu PGCI unit table 
(VTSM_PGCI_UT) 147, which is the fourth table, is a 
mandatory item when the video object set 
(VTSM_VOBS) 141 for video title set menus is pro- 
vided. Described in the table 147 are information on 
program chains for reproducing the video title set menu 
(VTSM) provided for each language. By referring to the 
video title set menu PGCI unit table (VTSM_PGCIJJT) 
147, a program chain for the specified language in the 
video object set (VTSM_VOBS) 141 can be acquired 
and reproduced as a menu. 

The video title set time search map table 
(VTS_MAPT) 148, which is the fifth table, is an optional 
table provided as the need arises. Described in the 
table 148 is information on the recording location of the 
video data in each program chain (PGC) in the title set 
102 to which the map table (VTS_MAPT) belongs, for a 
specific period of time of display. 

The video title set cell address table (VTS_C_ADT) 
149, which is the sixth table, is a mandatory item. 
Described in the table 149 are the addresses of each 
cell 84 constituting all the video objects 83 or the 
addresses of cell pieces constituting cells in the order 
the identification numbers of the video objects 83 are 
arranged. Here, a cell piece is a piece constituting a 
cell. Cells undergo an interleaving process in cell pieces 
and are arranged in a video object 83. 

The video object title set video object unit address 
map (VTS_VOBU_ADMAP) 150, which is the seventh 
table, is a mandatory item. Described in the table 150 
are the start addresses of all the video object units 85 in 
the video title set are described in the order of arrange- 
ment. 

The video title information management table 
(VTSI_MAT) 144, video title set part-of-title search 
pointer table (VTS_PTT_SRPT) 1 45, video title set pro- 
gram chain information table (VTS_PGCIT) 146 and 
video title set menu PGCI unit table (VTSMPGCIJJT) 
147, all shown in FIG. 22, will be described with refer- 
ence to FIG. 23 to 44. 

FIG. 23 shows the contents of the video title infor- 
mation manager table (VTSI_MAT) 144, in which the 
video title set identifier (VTSJD), end addresses 
(VTS_EA, VTSI_EA) of the video title set 102 and the 
video title set information, respectively, the version 
number (VERN) of the DVD video specification, the cat- 
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egory (VTS__CAT) of the video title set 102, and the end 
address (VTS l_M AT_E A) of the video title information 
manager table (VTSIJvlAT) 144 are described in that 
order. 

Furthermore, described in the table (VTSIJvlAT) 
144 are the start address (VTSM_VOBS_SA) of the 
video object set (VTSM_VOBS) 141 for the VTS menu 
(VTSM) and the start address (VTSTT_VOB_SA) of the 
video object for the title in the video title set (VTS). If the 
video object set (VTSM_BOBS) 141 for the VTS menu 
(VTSM) is absent, "OOOOOOOOh" will be described in the 
start address (VTSM_VOBS_SA). The end address 
(VTS l_M AT_E A) of VTSI_MAT is expressed by the 
number of logical blocks, relative to the first byte in the 
video title set information management table 
(VTSI_MAT) 144. The start address (VTSTM_VOB_SA) 
of VTSM_VOBS and the start address 
(VTSTT_VOB_SA) of VTSTT_VOB are expressed by 
logical blocks (RLBN) relative to the head logical block 
in the video title set (VTS) 102. 

In the table (VTSI_MAT) 144, the start address 
(VTS_PTT_SRPT_SA) of the video title set information 
part-of-title search pointer table (VTS_PTT_SRPT) 145 
is represented by the number of blocks, relative to the 
head logical block in the video title set information 
(VTSI) 140. Furthermore, in the table (VTSI_MAT) 144. 
the start address (VTS_PGCIT_SA) of the video title set 
program chain information table (VTS_PGCIT) 146 and 
the start address (VTS_PGCI_UT_SA) of the PGCI unit 
table (VTS_PGCI_UT) 147 of video title set menus rep- 
resented by the number of blocks, relative to the head 
logical block in the video title set information (VTSI) 1 40, 
and the start address (VTS_MAPT_SA) of the time 
search map table (VTS_MAPT) 148 in the video title set 
(VTS) is described in logical sectors which follows the 
first logical sector in the video title set (VTS) 102. Simi- 
larly, the VTS address table (VTS_C_ADT) 149 and the 
address map (VTS_VOBU_ADMAP) 150 for 
VTS_VOBU are described in logical sectors which fol- 
lows the head logical sector in the video title set (VTS) 
102. 

Described in the table (VTSIJvlAT) 144 are the 
video attribute (VTSM_V_ATR) of the video object set 
(VTSM_VOBS) 141 for the video title set menu (VTSM) 
in the video title set (VTS) 102, the number of audio 
streams (VTSM_AST_Ns), the attributes 
(VTSM_AST_ATR) of the audio streams, the number of 
sub-picture streams (VTSM_SPST_Ns), and the 
attributes (VTSM_SPST_ATR) of the sub-picture 
streams. Similarly, further described in the table 
(VTSIJvlAT) 144 are the video attribute (VTS_V_ATR) 
of the video object set (VTSM_VOBS) 142 for the video 
title set (VTSTT) for the video title set (VTS) in the video 
title set (VTS) 102. the number of audio streams 
(VTS_AST_Ns), the attributes (VTS_AST_ATR) of the 
audio streams, the number of sub-picture streams 
(VTS_SPSTJMs), and the attributes (VTS_SPST_ATR) 
of the sub-picture streams. Also described in this table 
(VTSI_MAT) 144 are the attrfcute (VTSJv1U_AST_ATR) 



of the multi-channel audio stream in the video title set 
(VTS). 

At most eight audio streams are provided, and at 
most 32 sub-picture streams are provided. Attribute is 

s described in each of these streams. In the sub-picture 
stream attribute (VTS_SPST_ATR) it is described 
whether the sub-picture is a language or not. 

The video title set part-of-title search pointer table 
(VTS_PTT_SRPT) 145 shown in FIG. 22 has the struc- 

10 ture shown in FIG. 24. As seen from FIG. 24, the table 
145 has three items. Described in the first item is part- 
of-title search pointer table information (PTT_SRPTI) 
161 . Described in the second item are n search pointers 
(TTU_SRP#n) 162 for title units #n. Described in the 

is third item are m part-of-title search pointers 
(PTT_SRP#m) 163 for m input numbers #m, for every 
title unit #n (TTU#n) 164. In the part-of-title search 
pointer table information (PTT_SRPTI) 161, there are 
descrtoed the number (VTS_TTU_Ns) of title search 

20 pointers in the video title set (VTS) and the end address 
(VTS_PTT_SRPT-EA) of the table (VTS_PTT_SRPT) 

145, as is illustrated in FIG. 25. The maximum number 
of title search pointers which can be described is 99. 
The end address (VTS_PTT_SRPT_EA) is described 

25 as the number of relative logical blocks, relative to the 
head byte of the table VTS_PTT_SRPT. Described in 
the title unit #n search pointer (TTU_SRP#n)162 is a 
start address (TTU_SA) of the title unit (TTU) which is 
collection of the title search pointer #m (PTT_SRP#m), 

30 as shown in FIG, 26. The start address (TTU_SA), 
which corresponds to the start address of the first title 
search pointer #1 table (PTT_SRPT) 163, is also 
described as the number of relative logical blocks, rela- 
tive to the head byte of the VTS_PTT_SRPT. Described 

35 in the title search pointer (PTTJ>RP#m) 163 are the 
program chain number (PGC_N) and program number 
PG_N which are designated by the title search pointer 
#m (PTT_SRP#m), as is illustrated in FIG. 27. 

The VTS program chain information table 

40 (VTS_PGCIT) 146 of FIG. 22 has a structure as shown 
in FIG. 28. In the information table (VTS_PGCIT) 146 
there is described information on the VTS program 
chains (VTS_PGC). The first item of this information is 
information (VTS_PGCIT_I) 172 on the information 

45 table (VTS_PGCIT) 146 of VTS program chains 
(VTS_PGC). In the information table (VTS_PGCIT) 

146, the information (VTS_PGCIT_I) 172 is followed by 
as many VTS_PGCI search pointers 
(VTS_PGCIT_SRP) used to search for VTS program 

so chains (VTS_PGC) as the number (from #1 to #n) of 
VTS program chains in the information table 
(VTS_PGCIT) 146. At the end of the table, there are 
provided as many pieces of information (VTS_PGCI) 
1 74 on the respective VTS program chains (VTS_PGC) 

55 as the number (from #1 to #n) of VTS program chains 
(VTS_PGC). 

The information (VTS_PGCIT_I) 172 in the VTS 
program chain information table (VTS_PGCIT) 146, as 
shown in FIG. 29, contains the number (VTS_PGC_Ns) 
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of VTS program chains (VTS_PGC) and the end 
address (VTS_PGCIT_EA) of the table information 
(VTS_PGCITJ) 172 expressed by the number of bytes, 
relative to the first byte of the information table 
(VTS_PGCIT) 146. 5 

Furthermore, as shown in FIG. 30, the VTS_PGCIT 
search pointer (VTS_PGCIT_SRP) 103 contains the 
attributes (VTS_PGC_CAT) of the program chains 
(VTS_PGC) in the video title set (VTS) 1 72 and the start 
address (VTS_PGCI_SA) of the VTS_PGC information 10 
(VTS_PGCI) expressed by the number of bytes, relative 
to the first byte of the VTS_PGC information table 
(VTS_PGCIT) 146. Here, the VTS_PGC attribute 
(VTS_PGC_CAT) contains, for example, an attribute 
indicating whether an entry program chain (Entry PGC) 15 
is the first one to be reproduced. Usually, an entry pro- 
gram chain (PGC) is described before program chains 
(PGC) that are not entry program chains (PGC). 

As shown in FIG. 31 , five items are described in the 
PGC information (VTS_PGCI) 174 for one PGC. The 20 
first item is a program chain general information 
(PGC_GI) 175. The second item is a program chain 
navigation command Table (PGC-CMDT) 176. The 
third, fourth and fifth mandatory items 1 78, 1 78 and 1 79 
are described if a video object exists following to naviga- 25 
tion command table (PGC_NV_CMDT). The third item 
is a program chain program map (PGC_PGMAP) 177, 
the fourth item is a cell playback information table 
(C_PBIT) 1 78, and the fifth item is a cell position infor- 
mation table (C_POSIT) 179. 30 

As shown in FIG. 32, the contents (PGC_CNT) of 
the program chain (PGC), and a PGC playback time 
(PGC_PB_TM) are described in the program chain gen- 
eral information (PGC_GI) 175. 

The contents (PGC_CNT) of PGC contain the 35 
description of the program chain structure, that is, the 
number of programs, the number of cells, etc. The play- 
back time (PGC_PB_TIME) of PGC contains the total 
playback time of the programs in the PGC, The play- 
back time is the time required to continuously playback 40 
the programs in the PGC, regardless of the playback 
procedure. 

Further described in the program chain general 
information (PGC_GI) 175 are, as shown in FIG. 32, 
PGC user operation control (PGC_UOP_CTL), PGC 45 
sub-picture stream control (PGC_SPST_CTL), PGC 
audio stream control (PGC_AST_CTL), and PGC navi- 
gation control (PGCJMV_CTL). In the PGC user opera- 
tion control (PGCJJOP_CTL), there is described a user 
operation which is prohibited during the reproduction of so 
the PGC. Using the described contents of PGC naviga- 
tion controls, PCGs are played back successively. This 
user operation is calling of a menu, changing of a sub- 
picture or an audio stream, or the like. Described in the 
PGC sub-picture stream number which can be used in 55 
the PGC, and similarly, described in the PGC audio 
stream control (PGC_AST_CTC) is audio stream 
number which can be used in the PGC. 

Further described in the program chain general 



information (PGCJ3I) 175 are PGC sub-picture palette 
(PGC_SP_PLT), the start address 

(PGC_NV_CMDT_SA) of PGC navigation command 
table (PGC_NV_CMDT) 176, the start address 
(PGC_PGMAP_SA) of PGC program map 
(PGC_PGMAP) 177, the start address (C_PBIT_SA) of 
the cell information table (C_PBIT)178, and the start 
address (C_POSIT_SA) of cell position information 
table (C_POSIT) 179. Described in the PGC sub-picture 
palette (PGC_SP_PLT) are 16 color palettes for all sub- 
pictures of the PGC. The start addresses of the 
PGC_NV command table (PGC_NV_CMDT) 176, PGC 
program map (PGC_PGMAP) 177 and cell position 
information table (C_POSIT) 179 are described in the 
form of the numbers of logical blocks, relative to the 
head byte of the PGC. If neither the cell playback infor- 
mation table (C_PBIT) 1 78 nor the cell position informa- 
tion table (C_POSIT) 179 exists, zeroes (0s) will be 
described in their start addresses. 

The program chain program map (PGC_PGMAP) 

177 of the PGC information (VTS_PGCI) 174 shown in 
FIG. 31 is a map representing the structure of the pro- 
gram in the PGC, as can be understood from FIG. 33. 
Described in the map (PGC_PGMAP) 177 are the entry 
cell numbers (ECELLN), the start cell numbers of the 
individual programs, in ascending order as shown in 
FIG. 34. In addition, program numbers are allocated, 
starting at 1 , in the order in which the entry cell numbers 
are described. Consequently, the first entry number in 
the map (PGC_PGMAP) 177 must be #1 . 

The cell playback information table (C_PBIT) 178 
defines the order in which the cells in the PGC are 
played back. In the cell playback information table 
(C_PBIT) 178 there are described pieces of the cell 
playback information (C_PBIT) consecutively as shown 
in FIG. 35. Basically, cells are played back in the order 
of cell number. The cell playback information (C_PBIT) 
contains a cell category (C_CAT) as playback informa- 
tion (P_PBI) as shown in FIG. 36. Written in the cell cat- 
egory (C_CAT) are a cell block mode indicating whether 
the cell is one in the block and if it is, whether the cell is 
the first one, a cell block type indicating whether the cell 
is not part of the block or is one in an angle block, an 
STC discontinuity flag indicating whether the system 
time clock (STC) must be set again, a cell playback 
mode, a cell navigation control and an inter-cell com- 
mand number. Here, a cell block is defined as a set of 
cells with a specific angle. The change of the angle is 
realized by changing the cell block. Taking baseball for 
example, the changing from an angle block of shooting 
scenes from the infield to an angle block of shooting 
scenes from the outfield corresponds to the change of 
the angle. 

As shown in FIG. 36. the playback information 
(P_PBI) of the cell playback information table (C_PBIT) 

178 contains the cell playback time (C_PBTTv1) repre- 
senting the total playback time of the PGC. When the 
PGC has an angle cell block, the playback time of the 
angle cell number 1 represents the playback time of the 
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angle block. Also described in the cell playback informa- 
tion table (C_PBIT) 178 are the start address 
(C_FVOBU_SA) of the first video object unit (VOBU) 85 
in the cell expressed by the number of logical blocks, 
relative to the first logical block in the video object unit 
(VOBU) 85 in which the cell is recorded and the start 
address (C_LVOBU_SA) and end address 
(C_LVOBU_EA) of the end video object unit (VOBU) 85 
in the cell expressed by the number of logical blocks, 
relative to the first logical block in the video object unit 
(VOBU) 85 in which the cell is recorded. 

The cell position information table (C_POSI) 179 
specifies the identification numbers (VOBJD) of the 
video objects (VOB) in the cell used in the PGC and the 
cell identification number (CJD). In the cell position 
information table (C_POSI), pieces of cell position infor- 
mation (C_POSI) corresponding to the cell numbers 
written in the cell playback information table (C_PBIT) 
178 as shown in FIG. 37 are described in the same 
order as in the cell playback information table (C_PBIT). 
The cell position information (C_POSI) contains the 
identification numbers (C_VOB_IDN) of the video object 
units (VOBU) 85 in the cell and the cell identification 
number (CJDN) as shown in FIG. 38. 

Further, the structure of the video title set PGCI unit 
table (VTSM_PGCl_UT) 147 shown in FIG. 22 will be 
explained with reference to FIGS. 37 to 44. The video 
title set PGCI unit table (VTSM_PGCI_UT) 147 has 
substantially the same structure as the VMGM_PGCI 
unit table 110 shown in FIG. 12. That is, in the 
VMGM_PGCI unit table (VTSM_PGCI_UT) 147, VTS 
menu PGCI unit table information (VTSM_PGCI_UTI) 

180 is first described as shown in FIG. 39, then VTS 
menu language unit search pointers (VMGM_LU_SRP) 

181 of a necessary number n corresponding to the 
number n of languages are successively described, and 
the VTS menu language unit (VTSMJJJ) 182 searched 
for by the search pointer is described. 

In the VTS menu PGCI unit table information 
(VTSM_PGCIJJTI) 180, the number (VTSM_LU_Ns) of 
VTSM language units (VTSM_LU) and the end address 
(VTSM_PGCI_UT_EA) of the VTSM_PGCI unit table 
(VMGM_PGCI_UT) 147 are described as shown in FIG. 
40. In each of n video manager menu language unit 
search pointers (VTSMJ_U_SRP) 181 prepared for 
respective languages, the language code (VTSMJXD) 
of the VTS menu and the start address (VTSMJLU_SA) 
of the VTS menu (VTSM) language unit (VTSMJ.U) 

182 are described as shown in FIG. 41. The end 
address (VTSM_PGCI_UT__EA) of VTSM_PGCMJT 
110 and the start address (VTSM_LU_SA) of 
VTSM_LU 352 are described by use of the logical block 
number from the first block of the VTSM_PGCl unit 
table (VTSM_PGCI_UT) 147. 

In each of n VTSM language units (VTSMJJJ) 182 
prepared for respective languages, VTSM menu lan- 
guage unit information (VTSM_LUI) 183 and 
VTSM_PGCI search pointers (VTSM_PGCI_SRP) 184 
of a number corresponding to the number of menu pro- 



gram chains are provided as shown in FIG. 42, and 
VTSM_PGC information items (VTSM_PGCI) 185 
searched for by the search pointers and corresponding 
in number to the menu program chains are provided as 

5 shown in FIG. 42. 

In each language unit information (VTSMJJJI) 183, 
the number (VMGM_PGCI_Ns) of VMGM_PGCIs and 
the end address (VTSM_LUI_EA) of the language unit 
information (VTSM_LUI) are descrfoed as shown in 

10 FIG. 43. Further, in the VTSM_PGCI search pointer 
(VTSM_PGCI_SRP), the VTSM_PGC category 
(VTSM_PGC_CAT) and the start address 
(VTSM_PGC1_SA) of VTSM_PGCI are described as 
shown in FIG. 44. The end address (vTSMJ_UI_EA) of 

is VTSMJ.UI and the start address (VTSM_PGCI_SA) of 
VTSM_PGCI are described by the number of logical 
blocks, relative to the head byte of VTSM_LU. As the 
VTSM_PGC category (VTSM__PGC_CAT), information 
indicating that the program chain is an entry program 

20 chain or title menu is described. 

As explained with reference to FIG. 6, a cell 84 is a 
set of video object units (VOBU) 85. A video object unit 
(VOBU) 85 is defined as a pack train starting with a nav- 
igation (NV) pack 86. Therefore, the start address 

25 (C_FVOBU„SA) of the first video object unit (VOBU) 85 
in a cell 84 is the start address of the NV pack 86. As 
shown in FIG. 45, the NV pack consists of a pack 
header 31 0, a system header 31 1 , and two packets of 
navigation data- a presentation control information 

30 (PCI) packet 316 and a data search information (DSI) 
packet 31 7. As many bytes as shown in FIG. 45 are allo- 
cated to the respective sections so that one pack may 
contain 2048 bytes corresponding to one logical sector. 
The NV pack is placed immediately in front of the video 

35 pack containing the first data item in the group of pic- 
tures (GOP). Even when the object unit 85 contains no 
video pack, an NV pack is placed at the head of the 
object unit containing audio packs or/and sub-picture 
packs. As with an object unit containing object units, 

40 even with an object unit containing no video pack, the 
playback time of the object unit is determined on the 
basis of the unit in which video is reproduced. 

Here, GOP is determined in the MPEG standard 
and is defined as a data train constituting a plurality of 

45 screens as explained earlier. Specifically, GOP corre- 
sponds to compressed data. Expanding the com- 
pressed data enables the reproduction of a plurality of 
frames of image data to reproduce moving pictures. The 
pack header 310 and system header 31 1 are defined in 

so the MPEG 2 system layer. The pack header 310 con- 
tains a pack start code, a system clock reference (SCR), 
and a multiplex rate. The system header 31 1 contains a 
bit rate and a stream ID. The packet header 312, 314 of 
each of the PCI packet 316 and DSI packet 317 con- 

55 tains a packet start code, a packet length, and a stream 
ID as determined in the MPEG2 system layer. 

As shown in FIG. 46, another video, audio, or sub- 
picture pack 88. 89, 80 and 291 consists of a pack 
header 320. packet header 321 , and a packet 322 con- 
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taining the corresponding data as determined in the 
MPEG2 system layer. Its pack length is determined to 
be 2048 bytes. Each of these packs is aligned with the 
boundaries between logical blocks. 

The PCI data (PCI) 313 in the PCI packet 316 is s 
navigation data used to make a presentation, or to 
change the contents of the display, in synchronization 
with the playback of the video data in the VOB unit 
(VOBU) 85. Specifically, as shown in FIG. 47, the PCI 
data (PCI) 313 contains PCI general information 10 
(PCI_GI) as information on the entire PCI and angle 
information (NSMLS_ANGLI) as each piece of jump 
destination angle information in angle change. The PCI 
general information (PCI_GI) contains the address 
(NV_PCK_LBN) of the NV pack (NV_PCK) 86 in which 15 
the PCI 113 is recorded as shown in FIG. 48. The 
address is expressed in the number of blocks, relative to 
the logical sector of VOBU 85 in which the PCI 313 is 
recorded. The PCI general information (PCI_GI) con- 
tains the category (VOBU_CAT) of VOBU 85, the start 20 
playback time (VOBU_S_PTlv1) of VOBU, and the end 
playback time (VOBU_EPTM) of VOBU. Here, the start 
PTS (VOBU_SPTS) of VOBU 85 indicates the playback 
start time (start presentation time) of the video data in 
the VOBU 85 containing the PCI 313. The playback 25 
start time is the first playback start time in the VOBU 85. 
Normally, the first picture corresponds to I picture (intra- 
picture) data in the MPEG standard. The end PTS 
(VOBU_EPTS) in the VOBU 85 indicates the playback 
end time (end presentation time) of the VOBU 85 con- 30 
taining the PCI 313. There is described in the PCI gen- 
eral information (PCI_GI), end PTM of sequence end in 
VOBU (VOBU_SE_E_PM) and cell elapse time 
(C_ELTM). 

DSI data (DSI) 31 5 in the DSI packet 317 shown in 35 
FIG. 45 is navigation data used to search for the VOB 
unit (VOBU) 85. Described in the DSI data (DSI) 315 
are DSI general information (DSI_GI), seamless infor- 
mation (SML_PBI), angle information (SML_AGLI), 
VOBU unit search information (VOBU_SRI), and syn- 40 
chronizing playback information (SYNCI), as shown in 
FIG. 49. 

The DSI information (DSI_GI) contains information 
about the entire DSI 315. Specifically, as shown in FIG. 
50, the DSI general information (DSI_GI) contains the 45 
system clock reference (NV_PCK_SCR) for the NV 
pack 86. The system clock reference (NV_PCK_SCR) 
is stored in the system time clock (STC) built in each 
section of FIG. 1. On the basis of the STC, video, audio, 
and sub-picture packs are decoded at the video, audio, so 
and sub-picture decoders 58, 60, and 62 and the moni- 
tor 6 and the speaker 8 reproduce images and sound, 
respectively. The DSI general information (DSI_GI) con- 
tains the start address (NV_PCK_LBN) of the NV pack 
(NV_PCK) 86 containing the DSI 31 5 expressed by the 55 
number of logical sectors (RLSN), relative to the first 
logical sector in the VOB set (VOBS) 82 containing the 
DSI 315, and the address (VOBU_EA) of the last pack 
in the VOB unit (VOBU) 85 containing the DSI 315 



expressed by the number of logical sectors (RLSN), rel- 
ative to the first logical sector in the VOB unit (VOBU). 

Furthermore, the DSI general information (DSIJ3I) 
contains the end address (VOBU_IP_EA) of the V pack 
(V_PCK) 88 containing the last address of the first I pic- 
ture in the VOBU expressed by the number of logical 
sectors (RLSN), relative to the first logical sector in the 
VOB unit (VOBU) containing the DSI 315, and the iden- 
tification number (VOBUJPJDN) of the VOBU 83 con- 
taining the DSI 315 and the identification number 
(VOBU_C_IDN) of the cell in which the DSI 315 is 
recorded. 

The VOBU search information (VOBU_SRI) of the 
DSI contains the addresses of a specified number of 
navigation packs. Video fast-forward etc. are effected, 
referring to the addresses. The synchronizing informa- 
tion (SYNCI) includes address information on the sub- 
pictures and audio data reproduced in synchronization 
with the playback start time of the video data in the VOB 
unit (VOBU) containing DSI 315. Specifically, as shown 
in FIG. 51, the start address (A_SYNCA) of the target 
audio pack (A_PCK) 91 is expressed by the number of 
logical sectors (RLSN), relative to the NV pack 
(NV_PCK) 86 in which DSI 31 5 is recorded. When there 
are more than one audio stream (8 audio streams, at 
most), as many pieces of synchronizing information 
(SYNCI) as audio streams are described. Furthermore, 
the synchronizing information (SYNCI) includes the 
address (SP__SYNCA) of the NV pack (NV_PCK) 86 of 
the VOB unit (VOBU) 85 containing the target audio 
pack (SP_PCK) 91 . The address is expressed by the 
number of logical sectors (RLSN), relative to the NV 
pack (NV_PCK) 66 in which DSI 315 is recorded. When 
more than one sub-picture stream (32 sub-picture 
streams, at most) exist, there described as many pieces 
of synchronizing information (SYNCI) as sub-picture 
streams. 

As described above with reference to FIG. 6, video 
data is compressed and stored in the video pack 88, 
while audio data is compressed or not compressed 
before it is stored in the audio pack 91. Similarly, sub- 
picture data is usually run-length-compressed and 
stored in the sub-picture data pack 90. The packs 88, 90 
and 91 are, as a pack sequence, sequentially supplied 
to the video decoder 58, the audio decoder 60 and the 
sub-picture decoder 62 shown in FIG. 1. The sub-pic- 
ture pack sequence is decoded by the sub-picture 
decoder 62 in units of sub-picture unit SPU which is an 
aggregate of integer number of sub-picture packs. That 
is, sub-picture data is formed into a unit such that a sub- 
picture, data unit 230 has a structure as shown in FIG. 
52. A sub-picture unit header (SPUH) 231 is provided 
for the leading end of the sub-picture data unit 230. 
Pixel data (PXD) 232 corresponding to an actual sub- 
picture image is provided to follow unit data 231. More- 
over, a display control sequence table (SP-DCSQT) 233 
is provided to follow pixel data 232. The sub-picture 
data units 232 are run-length-compressed or not com- 
pressed before they are stored in integer number of 
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sub-picture packs #i to #j90, as shown in FIG. 52. 
Although each of the sub-picture packs #i to #j90 has a 
length of 2048 bytes as shown in FIG. 52, the sub-pic- 
ture pack #j90 is adjusted to have 2048 bytes if the 
length of the sub-picture pack #j90 forming the trailing 
end of the sub-picture data unit 230 is shorter than 2048 
bytes. The length of the pack is adjusted such that a 
stuffing byte is inserted into the packet header 321 if the 
number of data items to be adjusted is 1 to 7 bytes and 
a padding packet is added to the sub-picture data 
packet 322 if the number of data items is 8 bytes or 
larger. 

The sub-picture unit header (SPUH) 230 shown in 
FIG. 53 has the size (SPDSZ) of the sub-picture unit 
and start address (SPDCSQTA) of the display control 
sequence table (SP_DCSQT) described therein, as 
shown in FIG. 54. As shown in FIG. 53, the display con- 
trol sequence table (SPJDCSQT) includes 0-th to n-th 
display control sequences (SP_DCSQ) 234. Each dis- 
play control sequence (SP_DCSQ) 234 has contents 
relating to display control of pixel data. That is, as 
shown in FIG. 55, the display control sequence 
(SP_DCSQ) 234 has start time (SP_DCSQ_STM) of 
the display control sequence (SPJDCSQ) 234, address 
(SP_NXT_DCSQ_SA) of the next display control 
sequence (SP_DCSQ) 234 and display sequence com- 
mand (SP_DCCMDn) described therein. 

Execution start time of SP_DCSQ is. in the start 
time (SP_DCSQ_STM) of SP_DCSQ, described as rel- 
ative display time (PTM) from presentation time stamp 
(PTS) described in the sub-picture pack Zero is 
described in the start time (SP_DCSQ_STM) of first 
SP__DCSQ. Next start address continued from the lead- 
ing byte of the sub-picture unit as the number of relative 
bytes is described in the address (SP_NXT_DCSQ_SA) 
of SP_DCSQ. 

The display sequence command (SP_DCCMD), as 
shown in FIG. 56, has nine commands. That is, a first 
command is a command (FSTA_DSP) for setting the 
start timing of forcible display of pixel data regardless of 
whether the sub-picture is displayed or not displayed. A 
second command is a command (STA_DSP) for starting 
display of the updated sub-picture unit. A third com- 
mand is a command (STP_DSP) for stopping display of 
the sub-picture unit. The sub-picture is again displayed 
when command STA_DSP is again executed even if 
STP_DSP is executed and thus it is stopped. A fourth 
command is a command (SET_COLOR) for setting the 
color of each pixel of pixel data. The command 
(SET_COLOR) contains the code of a color pallet. A 
fifth command is a command (SET_CONTR) for setting 
the mixture ratio of the main image and pixel data. The 
command (SET-CONTR) has the contrast of each pixel 
described therein. If the command (SET-CONTR) is not 
included in the display control sequence (SP_DCSQ) of 
the sub-picture unit, the mixture ratio set for the previ- 
ous sub-picture unit is maintained. A sixth command is 
a command (SETJDAREA) for setting the display region 
for pixel data. A seventh command is command 



(SET_DSPXA) for setting the address of pixel data for 
use in the display. The address is described as the 
number of relative bytes from the leading byte of the 
sub-picture unit. An eighth command is a command 

5 (CHG_COLCON) for setting change of the color and 
contrast of pixel data. A ninth command (CMD_END) is 
a command for completing display control command. 

The sub-picture decoder 62 shown in FIG, 1 
includes a circuit shown in FIG. 57 for processing the 

10 sub-picture data unit 230. That is, the sub-picture 
decoder 62 has a syntax decoder 241 to which sub-pic- 
ture data packets 322, from which a pack header 320 
and a packet header 321 are removed from each sub- 
picture pack 90 in the previous circuit, are sequentially 

is supplied. The syntax decoder 241 is controlled with 
STC (system time clock) 248 set by a system CPU 50 
and a stream selection register 242. That is, a reference 
is made to SCR to be described in the pack header 320 
by the system CPU 50 so that the STC (system time 

20 clock) 248 is set. Moreover, ID of the sub-picture stream 
is set to the stream selection register 242. Therefore, if 
PTS (presentation time stamp) descrtoed in the sub-pic- 
ture data packet 322 coincides with the time of the STC 
248. only the sub-picture packet 322 forming the sub- 

25 picture stream corresponding to the set ID is selected to 
be output to a FIFO 243 so as to be processed in the fol- 
lowing circuit. That is. the sub-picture packet 322 output 
from the FIFO 243 is suspended from the run-length 
compression by the run-length decoder 244. namely, 

30 expanded so as to be output to a sequence controller 
245. In the sequence controller 245, the unit header 231 
of the sub-picture data unit 230 is acquired so that the 
display control sequence table (SP_DCSQT) 233 is 
acquired. In accordance with the display control 

35 sequence (DCSQ) 234 described in the table 233, the 
command is decoded and the command is supplied to 
an output controller 247 in the display controller 246. 
Expanded pixel data 232 (PXD) is supplied from the 
sequence controller 245, the pixel data 232 (PXD) being 

40 used such that a sub-picture signal is supplied from the 
display controller 246 to a video mixer (not shown) in 
accordance with an output control state set to an output 
controller 247 by the system CPU 50 or an output con- 
trol state set with a command supplied from the 

45 sequence controller 245 to the output controller 247. 
The video mixer is supplied with a video signal obtained 
by decoding the video pack 88 from the video decoder 
58. The sub-picture signal is mixed with the foregoing 
video signal so as to be supplied to a monitor 6. 

so Hereinafter, the operation of reproducing the movie 
data from the optical disk 1 0 with the logic format shown 
in FIGS. 4 to 56 will be explained with reference to FIG. 
1 . In FIG. 1 . the solid-line arrows indicate data buses 
and the broken-line arrows represent control buses. 

55 To begin with, the operation of acquiring the video 
title set (VTS) 102 by the use of the video manager 
(VMG) 101 will be explained by reference to FIG. 58. 
With the optical disk apparatus of FIG. 1, when the 
power supply is turned on and an optical disk 10 is 
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loaded, the system CPU section 50 reads the initial 
operation program from the system ROM/RAM section 
52 and operates the disk drive section 30, which then 
starts a search operation as shown in step S41. 
Namely, the disk drive section 30 starts to read the data 5 
from the lead-in area 27 and then from the adjoining vol- 
ume and file structure area 100, in which a volume 
structure and a file structure are determined in accord- 
ance with ISO-9660. Specifically, to read the data from 
the volume and file structure area 100 located in a spe- 10 
cific position on the optical disk 10 set in the disk drive 
section 30, the system CPU section 50 gives a read 
instruction to the disk drive section 30 to read the con- 
tents of the volume and file structure area 100, and 
stores the data temporarily in the data RAM section 56 y 5 
via the system processor section 54. The system CPU 
section 50 extracts information about the recording 
position and recording size of each file and manage- 
ment information necessary for other managing actions 
via the path table and directory record stored in the data 20 
RAM section 56, and transfers and stores these pieces 
of information in specific locations in the system 
ROM/RAM section 52. 

Then, as shown in step S42, the system CPU sec- 
tion 50 acquires a video manager (VMG) 101 composed 25 
of files, starting with file number 0, by reference to the 
information about the recording position and recording 
capacity of each file in the system ROM/RAM section 
52. Specifically, referring to the recording position and 
recording capacity of each file acquired from the system 30 
ROM/RAM section 52, the system CPU section 50 gives 
a read instruction to the disk drive section 30, acquires 
the positions and sizes of a plurality of files constituting 
the video manager 101 existing on the root directory, 
reads the video manager (VMG) 101, and stores it in the 35 
data RAM section 56 via the system processor section 
54. Thereafter, the system CPU section 50 in the video 
manager (VMG) 101 stored in the data RAM section 56, 
as shown in step S43 t acquires the start addresses of 
the individual tables (TT_SRPT, VMGM_PGCI_UT J 40 
VTS_ART) written in the video management informa- 
tion table (VMGI_MAT) 108, thereby enabling the acqui- 
sition of each table. Here, when the user looks at a title 
brochure in which titles have been written, gets a 
number specifying a video title set, and enters the 45 
number directly from the key/display section 4 as shown 
in step S44, control will be passed to step S48. When 
there is no input entered by the user from the key/dis- 
play section 4, it will be confirmed as shown in step S45 
whether or not a VMGM video object set so 
(VMGM_VOBS) 106 is present as menu data in the 
video management information table (VMGI_MAT) 108. 
If there is no VMGM video object set (VMGM_VOBS) 
106, the user may enter a video title set or a predeter- 
mined video title set may be selected, and control will be 55 
passed to step S48. If a VMGM video object set 
(VMGM_VOBS) 106 is present, the video attribute infor- 
mation (VMGM_V_ATR) on VMGM and the attribute 
information ( VMGM_AST_ATR , VMGM_SPST_ATR) 



on audio and sub-picture streams will be acquired from 
the video management information table (VMGI_MAT) 
1 08. Thereafter, as shown in step S47, a menu will be 
displayed as shown in step S47, which will be explained 
in detail later by reference to FIG. 59. According to the 
menu representation, the user selects the video title set 
(VTS) 102 from the key/display section 4. Once the 
video title set (VTS) 102 has been selected, the video 
title set number (VTSN) corresponding to the selected 
video title set, title number (VTS_TTN), and the start 
address (VTS__SA) of the video title set are acquired 
from the title search pointer table (TT_SRPT) 109 in the 
video manager (VMG) 101. Furthermore, the system 
CPU 50 obtains attribute information (VTS_V_ATR, 
VTS_AST_ATR, VTS_SPST) of the acquired video title 
set number (VTSN) from the video title set attribute 
table (VTS__ATRT) 1 1 1 . On the basis of these pieces of 
attribute information (VTS_V_ATR, VTS_AST_ATR, 
VTS_SPST), the parameters necessary for playback of 
the video manager menu are set in the video decoder 
section 58, audio decoder section 60, and sub-picture 
decoder section 62, respectively. Furthermore, accord- 
ing to the pieces of attribute information, the video 
processing section 201, audio processing section 202, 
audio mixing section 203, and sub-picture processing 
section 207 in the D/A and data-reproducing section 64 
are set. By the above series of procedures, the prepara- 
tion to acquire the video title set 106 has been com- 
pleted as shown in step S50. 

Now, the operation going on as far as the video 
manager menu for choosing a video title is displayed will 
be described by reference to FIG. 59. When the menu 
search process is started as shown in step S10, the vol- 
ume manager information management table 
(VMGI_MAT) 108, the first table in the video manager 
101, will be searched. By the searching operation, the 
start address (VMGM_PGCI_UT_SR) of the 
VMGM_PGCi unit table (VMGM_PGCI_UT) 1 10 for the 
video manager menu (VMGM) is acquired. Then, the 
VMGM_PGCI unit table 1 10 is acquired. From the table 
information (VMGM_PGCIJJTI) in the table 
(VMGM_PGCI_UT) 110, the number (a) of language 
units (VMGM_LU_Ns) on the video manager menu is 
acquired. Then, as shown in step S1 1 , the acquisition of 
the search pointer (VMGM_LU_SRP) of the first #1 (n = 
1) VMGM_LU is determined. The search pointer 
(VMGM_LU_SRP) of the VMGM_LU is acquired as 
shown in step S12. Then, as shown in step S13, it is 
determined whether the language code (= b) 
(VMGM_LCD) written in the search pointer 
(VMGM_LU_SRP) of VMGM_L.ll coincides with the lan- 
guage code (= B) specified in the reproducing appara- 
tus, or the default language code. If the language codes 
do not coincide with each other, the number of the 
search pointer will be incremented (n = n + 1) as shown 
in step S14 and it will be determined whether the incre- 
mented number n has exceeded the number (a) of lan- 
guage units (VMGM_LU_Ns) in the video manager 
menu. If the number n has been set equal to or larger 
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than the number (a) of language units (VMGM JJJJMs) 
in the video manager menu, the searching operation for 
the video manager menu (VMGM) will be terminated as 
shown in step S16. If the number n is smaller than the 
number (a) of language units (VMGM_LU_Ns) in the 
video manager menu, control will be returned to step 
S13, where the n-th search pointer (VMGM_LU_SRP) 
of VMGMJ.U will be acquired and step Si 3 to step S15 
will be executed again. 

If in step S13, the language code (= b) 
(VMGM_LCD) written in the search pointer 
(VMGM_LU_SRP) of VMGMJJJ coincides with the lan- 
guage code (= B) specified in the reproducing appara- 
tus, or the default language code, the VMGM language 
unit (VMGMJJJ) 127 corresponding to the language 
code written in the search pointer (VMGM_LU_SRP) of 
VMGMJJJ will be acquired as shown in step S1 7. The 
number (VMGM_PGCI_Ns) of VMGM_PGCI is 
extracted from the VMGM language unit information 
(VMGM_LUI). Next, as shown in step S18, the 
VMGM_PGC category (VMGM_PGC_CAT) is acquired 
from the VMGM_PGCI search pointer 
(VMGM_PGCI_SRP) 131. Thus, the VMGM_PGC 
number corresponding to the menu ID (="0010") as well 
as to the entry type (= 1) is acquired from the 
VMGM_PGC category (VMGM_PGC_CAT). Here, the 
menu ID (="0010") corresponds to the VMGM title 
menu. The start address (VMGM_PGC_SA) of the 
VMGM_PGC corresponding to the acquired 
VMGM_PGC number is obtained from the 
VMGM_PGCI search pointer (VMGM_PGCLSRP) and 
as shown in step S19, the relevant PGC is acquired 
from the VMGM video object set (VMGM_VOBS) 106, 
thereby reproducing the PGC. 

As a result, the VMG menu is displayed. For exam- 
ple, titles of movie series appear. When the first title set 
is chosen, the title set corresponding to the first one is 
acquired as follows. 

The start address (VTS_SA) of the video title set 
102 is acquired from the title search pointer 121 having 
the entry number #1 shown in FIG. 8. Then, the video 
title set information (VTSl) 140 on the title set shown in 
FIG. 22 is obtained. From the management table 
(VTSI_MAT) 1 44 of the video title set information (VTSl) 
140, the end address ( VTS l_M AT_E A) of the video title 
set information management table (VTSI_MAT) 144 
shown in FIG. 23 is acquired. Furthermore, on the basis 
of the number of audio streams and the number of sub- 
picture streams (VTS_AST_Ns, VTS_SPST_Ns) and 
the attribute information (VTS_V_ATR, VTS_A_ATR, 
VTS_SPST_ATR) on the audio and video data, each 
section of the reproducing apparatus of FIG. 1 is set. 
Specifically, according to the attribute information, the 
audio processing section 202, audio mixing section 203, 
and sub-picture reproducing section 207 in the D/A and 
reproducing section 64 are set. 

When the video title set menu (VTSM) is present, 
the video title set menu will be displayed according to 
the flow shown in FIG. 60. Specifically, when the menu 



search process is started as shown in step S20, this 
enables the start address (VTSM_PGCI_UT_SA) of the 
VTSM_PGCI unit table (VTS_PGCI_UT) 146 for the 
video title set menu (VTSM) to be acquired from the 

5 video title set information management table 
(VTSI_MAT) 144. Then, the VTSM_PGCI unit table 146 
is acquired. From the table information 
(VTSM_PGCLUTI) 146, the number (a) of language 
units (VTSMJ-UJMs) on the video title menu is 

io acquired. Then, as shown in step S21 , the acquisition of 
the search pointer (VTSM_LU_SRP) 181 of the first #1 
(n = 1) VTSMJJJ is determined. The search pointer 
(VTSM_LU_SRP) 181 of the VTSMJJJ 182 is acquired 
as shown in step S22. Then, as shown in step S23, it is 

75 determined whether the language code (= b) 
(VTSMJ.CD) written in the search pointer 
(VTSM_LU_SRP) 181 of VTSMJ.U 182 coincides with 
the language code (= B) specified in the reproducing 
apparatus, or the default language code. If the language 

20 codes do not coincide with each other, the number of 
the search pointer will be incremented (n = n + 1) as 
shown in step S24 and it will be determined whether the 
incremented number n has exceeded the number (a) of 
language units (VTSM_LU_Ns) in the video title set 

25 menu. If the number n has been set equal to or larger 
than the number (a) of language units (VTSM_LU_Ns) 
in the video title set menu, the searching operation for 
the video title set menu (VTSM) will be terminated as 
shown in step S26. If the number n is smaller than the 

30 number (a) of language units (VTSM_LU_Ns) in the 
video title set menu, control will be returned to step S22, 
where the n-th search pointer (VTSM_LU_SRP) 181 of 
VTSM_LU will be acquired and step S23 to step S25 will 
be executed again. 

35 If in step S23, the language code (= b) 
(VTSMJ.CD) written in the search pointer 
(VTSM_LU_SRP) 181 of VTSM_LU coincides with the 
language code (= B) specified in the reproducing appa- 
ratus, or the default language code, the VTSM language 

40 unit (VTSMJJJ) 182 corresponding to the language 
code written in the search pointer (VTSM_LU_SRP) 
181 of VTSMJJJ will be acquired as shown in step S27. 
The number (VTSM_PGCI_Ns) of VTSM_PGCI is 
extracted from the VTSM language unit information 

45 (VTSMJJJI). Next, as shown in step S28, the 
VTSM_PGC category (VTSM_PGC_CAT) is acquired 
from the VTSM_PGCI search pointer 
(VTSM_PGCI_SRP) 184. Thus, the VTSM_PGC 
number corresponding to the menu ID (= "0011" to 

so "0111") as well as to the entry type (= 1) is acquired 
from the VTSM_PGC category (VTSM_.PGC_.CAT). 
Here, the menu ID (="001 1" to "01 11") corresponds to 
the VTSM audio menu for selecting an audio language 
or VTSM program menu for selecting a program or the 

55 other menu. The start address (VTSM_PGC_SA) of the 
VTSM_PGC corresponding to the acquired 
VTSM_PGC number is obtained from the VTSM_PGCI 
search pointer (VTSM_PGCLSRP) and as shown in 
step S29, the relevant PGC is acquired from the VTSM 
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video object set (VTSM_VOBS) 141, thereby reproduc- 
ing the PGC. Thus, the VTS menu is displayed. Once 
the user has chosen a part of the title from the menu by 
pressing the corresponding key on the key/display sec- 
tion 4, for example, the language selection menu, a sub- 5 
menu, appears. Specifically, since 32 sub-picture 
streams have been prepared as sub-pictures as 
explained earlier, the movie suppliers can display one 
of, for example, English, Japanese, German, and 
French sub-pictures. Furthermore, a menu that allows to 
selection of one from eight audio streams can be pre- 
pared as another submenu. This makes it possible to 
choose any one of audio streams associated with dub- 
bing. Selecting a choice from the menu causes the pro- 
gram chain corresponding to the choice to be 15 
reproduced. 

When the menu (VTSM) for video title sets (VTS) 
has a simple structure, the start address 
(VTSM_VOB_SA) of the video object set (VTSM_VOB) 
141 for video title set menus may be acquired from the 20 
video title set information management table 
(VTSI_MAT) 144 of FIG. 34 and the menu for video title 
sets may be displayed according to the video object set 
(VTSM_VOB) 141. 

Now, the operation of retrieving and reproducing a 25 
program chain after the title has been chosen will be 
explained by reference to the flows shown in FIG. 61 . 
Specifically, when the user specifies a program chain 
(PGC) from the key/display section 4, referring to the 
menu, the desired program chain will be searched for by 30 
the following procedure. This procedure applies to not 
only the retrieval of a program chain for titles in a video 
title set, but also the retrieval of a program chain for 
menus, each of which is a relatively complex menu 
made up of a program chain. As shown in FIG. 61 , after 35 
a searching operation has been started as shown in 
step S51, the system CPU section 50 acquires video 
title set information 140 as shown in step S52 as 
explained earlier. Then, as shown in step S53, the start 
address of each table is obtained from the acquired 40 
video title set information 140. The table 
(VTS_PTT_SRPT) 145 is acquired according to the 
start address (VTS_PTT_SRPT_SA) of the video title 
set part-of-titte search pointer table (VTS_PTT_SRPT) 
145 among these obtained start addresses. Next, as 45 
shown in step S54, on the basis of the number (VTSN) 
of the video title set 296 obtained by reference to the 
title search pointer (TT_SRP) 279 of the video manager 
(VMG) 101 and the VTS title number (VTS_TTN), the 
PGC number corresponding to the part of the title spec- so 
ified by the user and the PG number are acquired. 

By referring to the VTS-PGCI table (VTS_PGCIT) 
146, the VTS_PGC search pointer #n (VTS_PGCI_SRP 
#n) 303 corresponding to the acquired PGC number is 
obtained. On the basis of the pointer #n 55 
(VTS_PGCI_SRP #n) 303, the category 
(VTS_PGC_CAT) of the VTS_PGC and the start 
address (VTS_PGCI_SA) of the VTS_PGC information 
(VTS_PGCI #n) 304 pointed out by the pointer are 



acquired. As shown in step S56, according to the start 
address (VTS_PGCI_SA) of the VTS_PGC information 
(VTS_PGCI #n) 304, the VTS_PGC information 
(VTS.PGCI #n) 304 is acquired. As shown in step S57, 
on the basis of the PGC general information (PGC_GI) 
175 in the acquired VTS_PGC information (VTS_PGCI 
#n) 304, the contents (PGC_CNT) of the PGC are 
acquired. Then, from the PGC_CNT ( the number of pro- 
grams in the PGC and the number of cells are obtained. 

After all of the pre-navigation commands 
(PRE_NV„CMD) have been executed, the PGC pro- 
gram map (PGCJvlAP) 306 and cell playback informa- 
tion (C_PBIT) are acquired and as shown in step S59, 
the playback of the specified program (x), or the play- 
back of cells, is started. Once the playback of a program 
has been completed as a result of cell playback, the pro- 
gram number is updated (x = x + 1) as shown in step 
S60, and it is confirmed as shown in step S61 whether 
any updated program number is present. Namely, it is 
verified whether the program reproduced before play- 
back is the last program. If there is a program having the 
updated program number, control will be passed to step 
S59, where the updated program will be reproduced. If 
the reproduced program is the last program, the selec- 
tion menu for choosing a program to be next reproduced 
will be displayed as shown in step S62. The menu may 
have the choices appear in a sub-picture with the cell 
playback kept in a halt, or with moving pictures appear- 
ing on the screen by repeating the cell playback. 

When the user has chosen a subsequent PGC from 
the selection menu, the PGC number at the branch des- 
tination chosen by the user is set in the register speci- 
fied by the set command or the like. At this time, the 
language previously held in the apparatus, or the player, 
is referred to and an audio stream and a video stream 
are set. Once the next PGC number has been deter- 
mined, it is confirmed whether there is any subsequent 
PGC number as shown in step S65. If a subsequent 
PGC is present, control will be passed again to step 
S55. If there is no PGC number, the playback of PGC 
will be terminated as shown in step S66. 

When display control command (SP_DCCMD) is 
described in the display control sequence (DCSQ) 
described in the display control sequence table 
(SP_DCSQT) 233 of the sub-picture data unit 230, a 
sub-picture is presented forcibly through a process, for 
example, shown in FIG. 62. 

When the sub-picture data unit 230 has started the 
process in step S71 shown in FIG. 62, a menu for 
selecting the audio stream and the sub-picture stream is 
displayed in step S72 as described with reference to 
FIGS. 59 and 60. If key operation and key input from the 
display portion 4 to select the audio stream and the sub- 
picture stream are performed in step S73 in accordance 
with the foregoing menu, the stream selection register 
242 and the output controller 247 of the display control- 
ler 246 shown in FIG. 57 are set by the CPU 50. If out- 
put of the sub-picture is not selected, the sub-picture 
stream in the same language as that of the selected 
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audio stream is set to the stream selection register 242. 
[f the output of the sub-picture is not selected, the output 
controller 247 is set to be a state where no sub-picture 
signal is output from the display controller 246, that is, a 
picture output mute state. 

After the stream has been selected, decoding of the 
stream is started in step S74. That is, sub-picture packs 
90 including non-selected streams are sequentially sup- 
plied from a data RAM 56 to the sii>picture decoder 62 
through the system processor 54. In the sub-picture 
decoder 62, the sub-picture data packets 322 are cut 
from the sub-picture pack 90. The cut sub-picture data 
packets 322 are sequentially supplied to the syntax 
decoder 241. The syntax decoder 241 makes a refer- 
ence to the PTS described in the sub-picture data 
packet 322 with the SCR 248 to output the sub-picture 
data packet 322 having the stream corresponding to the 
ID set to the stream selection register 242 to the run- 
length decoder 244 through the FIFO 243. If a user has 
not selected display of the sub-picture and as well as if 
the language of the selected audio stream or the audio 
stream is not selected, the ID of a sub-picture stream 
corresponding to the default language for the apparatus 
is set to the stream selection register 242. The sub-pic- 
ture data packet 322 supplied to the run-length decoder 
244 is expanded in the run-length decoder 244. The 
expanded sub-picture data unit 230 is supplied to the 
sequence controller 245. In the sequence controller 
245, a reference is made to the start address (SPDC- 
SQTA) of the display sequence table with the unit 
header (SPUH) 231 in the sub-picture data unit 230 to 
acquire the sub-picture display sequence table 
(SP_DCSQ). Reproduction control information 
described in the sequence table (SP_DCSQ) is sup- 
plied to the output controller 247. Moreover, pixel data 
(PXD) in the sub-picture data unit 230 is supplied to the 
display controller 246. The display controller 246 con- 
trols output of pixel data (PXD) supplied by the output 
controller 247. 

If the user has selected output of the sub-picture in 
step S76, the display control command SP_DCCMD is 
supplied to the output controller 247 at the start time of 
SP_DCSQ descrtoed in the sub-picture display 
sequence table (SP_DCSQ). In accordance with the 
command (STA_DSP) for setting the start timing to dis- 
play pixel data as the display control command 
SP_DCCMD, output of pixel data (PXD) to the video 
mixer is started. Thus, the sub-picture is displayed on 
the monitor 6 together with the main picture so that 
usual output of a picture is executed in step S57. As 
described above, the sub-picture is displayed on the 
monitor 6 with pixel data (PXD) in the sub-picture data 
units 230 which have been sequentially supplied. How- 
ever, if the sub-picture display sequence table 
(SP_DCSQ) in the sub-picture data unit 230 includes 
the command (STP_DSP) for setting the timing for stop- 
ping display of pixel data as the display control com- 
mand SP_DCCMD, display of the sub-picture is 
interrupted. By repeating the foregoing process, the 



sub-picture is displayed, if necessary. 

If the user has not selected output of the sub-pic- 
ture in step S76, an instruction to mute the output of the 
sub-picture is supplied from the system CPU 50 to the 

s output controller 247. Thus, the output controller 247 
mutes the output of the sub-picture pixel data in step 
S81. Therefore, the sub-picture is not displayed in the 
main picture on the monitor 6. If command (FSTAJDSP) 
for forcibly setting the display start timing of pixel data is, 

10 in step S78, detected, as the display control command 
SP_DCCMD, in the sub-picture display sequence table 
(SP_DCSQ) during the mute of the display of the sub- 
picture, a reference is made to the language of the 
selected audio stream or the default language in step 

is S79. Thus, output of pixel data (PXD) of the sub-picture 
stream corresponding to the language to the video 
mixer is permitted. In step S80 the sub-picture is dis- 
played on the monitor 6. Then, the process is returned 
to step S76 so that display is continued until the com- 

20 mand (STP_DSP) for setting the timing for stopping the 
display of pixel data is detected as the display control 
command SP_DCCMD. If the command (FSTA_DSP) is 
not detected in step S78, the mute state of display of the 
sub-picture is, as a matter of course, maintained in step 

25 S81 . In step S82 the operations in steps S76 to S82 are 
repeated until completion of the sub-picture stream is 
detected. If completion of the sub-picture stream is 
detected, the sequential process for the forcible presen- 
tation of the picture is completed in step S83. 

30 The forcible presentation shown in FIG. 62 has the 
structure such that an English sub-picture stream is 
selected and thus the English sub-picture is displayed if 
a sub-picture stream corresponding to the audio 
stream, for example, the English audio stream has been 

35 selected. Another structure may be employed in which a 
sub-picture stream, the presentation of which is forcibly 
performed, is selected as shown in FIGS. 63A and 63B 
if a user has selected the sub-picture stream or if a 
default sub-picture stream has been provided for the 

40 apparatus or an optical disk. The forcible picture pres- 
entation process according to this embodiment will now 
be described with reference to FIGS. 63A and 63B. 

If the process of the sub-picture data unit 230 has 
been started in step S91 shown in FIG. 63A, the menu 

45 for selecting the audio stream and the sub-picture 
stream is displayed in step S92 as described with refer- 
ence to FIGS. 59 and 60, If key operation has been per- 
formed or key input for selecting the audio stream has 
been performed from the display portion 4 in step S93 in 

50 accordance with the above-mentioned menu, the sys- 
tem CPU 50 acquires the selected audio stream in step 
S94 so that the stream selection register in the audio 
decoder 60 and the output control unit for the display 
controller similar to those shown in FIG. 57 are set by 

55 the system CPU 50. If the audio stream is not selected 
in step S95, the default audio stream formed in accord- 
ance with a language code previously set to the player 
is acquired by the system CPU 50 in step S95. Thus, 
the stream selection register and the output control unit 
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for the display controller are similarly set by the system 
CPU 50. The default audio stream may previously be 
provided by a provider for the inside portion of the for- 
mat of the optical disk If a key operation has been per- 
formed or if key input for selecting the sub-picture 5 
stream has been performed from the display portion 4 in 
accordance with the menu in step S96, the system CPU 
50, in step S97, acquires the selected sub-picture 
stream. Then, the stream selection register 242 and the 
output control unit 247 for the display controller 246 w 
shown in FIG. 57 are set by the system CPU 50. If the 
sub-picture stream is not selected in step S95, the 
default sub-picture stream formed in accordance with 
the language code and previously provided for the 
player or the disk is, in step S98, acquired by the system 15 
CPU 50. Similarly, the stream selection register 242 and 
the output control unit 247 of the display controller 246 
are set by the system CPU 50. Similarly to the default 
audio stream, the default sub-picture stream may be 
provided for the inside portion of the format of the opti- 20 
cal disk by the provider. 

If the presentation of the sub-picture is not selected, 
the output control unit 247 is set to be a state where the 
sub-picture signal is not output from the display control- 
ler 246, that is, a state of muting the presentation. 25 

After the selection of the stream has been com- 
pleted, decoding of the stream is started in step S99. 
That is, sub-picture packs 90 are sequentially supplied 
from the data RAM 56 to the sub-picture decoder 62 
through the system processor 54. In the sub-picture 30 
decoder 62, the sub-picture data packets 322 are 
obtained from the sub-picture pack 90 by cutting. The 
sub-picture data packets 322 obtained by cutting are 
sequentially supplied to the syntax decoder 241. The 
syntax decoder 241 makes a reference to the PTS 35 
described in the sub-picture data packet 322 with the 
SCR 248 to output the sub-picture data packet 322 hav- 
ing the stream corresponding to the ID of the stream set 
to the stream selection register 242 to the run-length 
decoder 244 through the FIFO 243. If the user selects 40 
and causes the sub-picture to be displayed in step 
S100, a usual presentation is performed in step S101. 

Also in a case where the user does not select the 
presentation of the sub-picture and thus the presenta- 
tion of the sub-picture is not performed, the ID of the 45 
selected or default sub-picture stream is set to the 
stream selection register 242. The sub-picture data 
packets 322 supplied to the run-length decoder 244 is 
expanded in the run-length decoder 244. The expanded 
sub-picture data unit 230 is supplied to the sequence so 
controller 245. In the sequence controller 245, a refer- 
ence is made to start address (SPDCSQTA) of the dis- 
play sequence table in accordance with the unit header 
(SPUH) 231 in the sub-picture data unit 230 so that the 
sub-picture display sequence table (SP_DCSQ) is ss 
acquired. Reproduction control information described in 
the sequence table (SP_DCSQ) is supplied to the out- 
put control unit 247. Moreover, pixel data (PXD) in the 
sub-picture data unit 230 is supplied to the display con- 



troller 246. The display controller 246 controls output of 
pixel data (PXD) supplied by the output control unit 247. 

If presentation of the sub-picture has been selected 
by the user in step S100, display control command 
(SP_DCCMD) is supplied to the output control unit 247 
at the start time SP_DCSQ described in the sub-picture 
display sequence table (SP_DCSQ). The display con- 
trol command SP_DCCMD causes output of pixel data 
(PXD) to the video mixer to be started in accordance 
with a command (STA_DSP) for setting timing at which 
display of pixel data is started. Thus, the sub-picture is 
displayed on the monitor 6 together with the main pic- 
ture. As a result, a usual presentation of the picture is 
performed in step S101 . Pixel data (PXD) in the sub-pic- 
ture data units 230 which have been sequentially sup- 
plied causes the sub-picture to be displayed on the 
monitor 6. If the sub-picture display sequence table 
(SP_DCSQ) in the sub-picture data unit 230 has a com- 
mand (STP_DSP) for setting the timing at which display 
of pixel data is stopped as the display control command 
SP_DCCMD, display of the sub-picture is stopped. The 
foregoing operation is repeated so that the sub-picture 
is displayed if necessary. 

If the user has not selected the presentation of the 
sub-picture in step S1 00, an instruction to mute presen- 
tation of the sub-picture is supplied from the system 
CPU 50 to the output control unit 247. The output con- 
trol unit 247 mutes output of sub-picture pixel data in 
step S103. As a result, the sub-picture is not displayed 
in the main picture on the monitor 6. If a command 
(FSTA_DSP) for setting the timing at which display of 
pixel data is forcibly started is, in step S102, detected in 
the sub-picture display sequence table (SP_DCSQ) as 
the display control command SP_DCCMD during mut- 
ing of the presentation of the sub-picture, whether or not 
the sub-picture has been selected is confirmed in step 
S104. Then, a reference is made to the selected lan- 
guage in step S105 or a reference is made to the default 
language in step S1 06 so that output of pixel data (PXD) 
of the sub-picture stream corresponding to the lan- 
guage to the video mixer is permitted. As a result, the 
sub-picture is displayed on the monitor 6. After the dis- 
play has been performed, the operation returns to step 
S100 so that the display is continued until a command 
(STP_DSP) for setting the timing at which display of 
pixel data is stopped is detected as the display control 
command (SP_DCCMD). That is, if the command 
(FSTA_DSP) is not detected in step S102, muting of the 
display of the sub-picture is, as a matter of course, 
maintained in step S103. The operations from step 
S100 to step S107 are repeated until completion of the 
sub-picture stream is detected in step S107. When 
completion of the sub-picture stream is detected, the 
sequential process for forcibly performing presentation 
is completed in step S83. 

When the command for performing the forcible 
presentation shown in FIGS. 63, 64A and 64B is per- 
formed, other commands shown in FIG. 56, for exam- 
ple, display timing (STA_DSP) and display stop timing 
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(STP_DSP) are performed so that the sub-picture is for- 
cibly displayed in an adequate display region with 
proper contrast and hue. That is, the forcible presenta- 
tion command (FTS_DSP) is performed together with 
the other commands shown in FIG. 56. 

Referring to FIGS. 64 to 69, explained next will be a 
method of recording data on the optical disk 1 0 on and 
from which the video data is recorded and reproduced 
in the logic formats shown in FIGS. 4 to 56 and a record- 
ing system to which the recording method is applied. 

FIG. 64 shows an encoder system that creates a 
video file 104 of a title set 102 whose video data is 
encoded. In the system of FIG. 64, for example, a vide- 
otape recorder (VTR) 401, an audiotape recorder (ATR) 
402, and a sub-picture source 403 are used as sources 
of the main video data, audio data, and sub-picture 
data. Under the control of a system controller (Sys con) 
405, they create the main video data, audio data, and 
sub-picture data, which are supplied to a video encoder 
(VENC) 406, an audio encoder (AENC) 407, and a sub- 
picture encoder (SPENC) 408, respectively. Under the 
control of the system controller (Sys con) 405, these 
encoders 406, 407, and 408 perform A/D conversion of 
the main video data, audio data, and sup-picture data 
and encode them by the respective compression 
schemes. The encoded main video data, audio data, 
and sub-picture data (Comp Video, Comp Audio, Comp 
Sub-pict) are stored in memories 410, 41 1 , and 412. 

The main video data, audio data, and sub-picture 
data (Comp Video, Comp Audio, Comp Sub-pict) are 
outputted to a file formatter (FFMT) 414 under the con- 
trol of the system controller (Sys con) 405, which con- 
verts them so that they may have a file structure of video 
data for the system as explained earlier. Then, under 
the control of the system controller (Sys con) 405, the 
setting conditions for each data item and the manage- 
ment information including attributes are stored in a 
memory 416 in the form of files. 

Explained next will be a standard flow of an encod- 
ing process in the system controller (Sys con) 405 that 
creates a file from video data. 

According to the flow of FIG. 65, the main video 
data and audio data are encoded and the encoded main 
video data and audio data (Comp Video, Comp Audio) 
are supplied. Specifically, when the encoding process is 
started, as shown in step S270 of FIG. 65, the parame- 
ters necessary for encoding the main video data and 
audio data are set. Part of the set parameters are stored 
in the system controller (Sys con) 405 and at the same 
time, are used at the file formatter (FFMT) 414. As 
shown in step S271 , the main video data is pre-encoded 
using the parameters and the optimum distribution of 
the amount of codes is calculated. Then, on the basis of 
the code amount distribution obtained in the pre-encod- 
ing, the main video data is encoded as shown in step 
S272. At the same time, the audio data is also encoded 
at step S272. As shown in step in S273, if necessary, 
the main video data is partially encoded again and the 
reencoded portion of the main video data is replaced 



with the old one. Through the series of steps, the main 
video data and audio data are encoded. Furthermore, 
as shown in steps S274 and S275, the sub-picture data 
is encoded and the encoded sub-picture data (Comp 

5 Sub-pict) is supplied. Namely, the parameters neces- 
sary for encoding the sub-picture data are set. As 
shown in step S274, part of the parameters are stored 
in the system controller (Sys con) 405 and used in the 
file formatter (FFMT) 414. On the basis of the parame- 

10 ters, the sub-picture data is encoded as shown in step 
S275. By the process, the sub-picture data is encoded. 

According to the flow of FIG. 66, the encoded main 
video data, audio data, and sub-picture data (Com 
Video, Com Audio, Comp Sub-pict) are combined and 

is converted so as to form a video data title set structure 
as explained in FIGS. 4 and 22. Specifically, as shown in 
step S276, a cell is set as the smallest unit of the video 
data and cell playback information on the cell (C_PBI) is 
created. Then, as shown in step S277, the structure of 

20 the cells constituting a program chain and the main 
video, sub-picture, and audio attributes (the information 
obtained in encoding the respective data items is used 
as part of these attributes) are set. Then, as shown in 
FIG. 22, a video title set information management table 

25 information (VTSI_MAT) 144 including information on 
program chains and a video title set program chain table 
(VTS_PGCIT) 146 are created. At this time, as the need 
arises, a video title set direct access pointer table 
(VTS_DAPT) is also created. The encoded main video 

30 data, audio data, and sub-picture data (Com Video, 
Comp Audio, Comp Sub-pict) are subdivided into spe- 
cific packs. An NV pack is placed at the head of each 
VOBU so that playback can be effected in the order of 
time code of each data item. With the NV packs 

35 arranged this way, each data cell is positioned so that a 
video object (VOB) may be composed of a plurality of 
cells as shown in FIG. 6. A set of such video objects is 
formatted into the title set structure. 

In the flow of FIG. 66, the program chain informa- 

40 tion (PGI) is obtained in the process of step S277 by 
using the database in the system controller (Sys con) 
405 or entering data again as the need arises. 

FIG. 67 shows a disk formatter system that records 
on an optical disk the title set formatted as described 

45 above. In the disk formatter system of FIG. 67, the 
memories 420, 422 in which the created title set is 
stored supply these file data items to a volume formatter 
(VFMT) 426. The volume formatter (VFMT) 426 extracts 
the management information from the title sets 284, 

so 286, produces a video manager 101, and creates the 
logic data to be recorded on the disk 1 0 in the arrange- 
ment of FIG. 4. A disk formatter (DFMT) 428 adds error 
correction data to the logic data created at the volume 
formatter (VFMT) 426. thereby reconverting the logic 

55 data into physical data to be recorded on the disk. A 
modulator 430 converts the physical data created at the 
disk formatter (DFMT) 428 into the recording data to be 
recorded actually on the disk. Then, a recorder 432 
records the modulated recording data on the disk 10. 
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A standard flow for creating the aforementioned 
disk will be described with reference to FIGS. 68 and 
69. FIG. 68 shows the flow of creating the logic data to 
be recorded on the disk 10. Specifically, as shown in 
step S280, parameter data items, including the number 5 
of video data files, their arrangement, and the size of 
each video data file, are set first. Next, as shown in step 

5281, a video manager 101 is created from the set 
parameters and the video title set information 140 in 
each video title set 102. Thereafter, as shown in step 10 

5282, the video manager 101 and video title set 102 are 
arranged in that order according to the corresponding 
logical block number, thereby creating the logic data to 
be recorded on the disk 10. 

Thereafter, the flow of creating the physical data to is 
be recorded on the disk as shown in FIG. 69 is exe- 
cuted. Specifically, as shown in step S283, the logic 
data is divided into units of a specific number of bytes, 
thereby forming error correction data. Next, as shown in 
step S284, the logic data divided into units of a specific 20 
number of bytes are combined with the created error 
correction data to form physical sectors. Thereafter, as 
shown in step S85, physical data is created by combin- 
ing physical sectors. In this way, the modulating process 
based on certain rules is performed on the physical data 25 
created in the flow of FIG. 69. thereby forming the 
recording data. Thereafter, the recording data is 
recorded on the disk 10. 

The above-described data structure can be applied 
not only to a case where the data is recorded on record- 30 
ing mediums, such as optical disks, and then the disks 
are distributed to the users, who play back them, but 
also to a communication system as shown in FIG. 70. 
Specifically, according to the procedures shown in 
FIGS. 64 to 67, an optical disk 10 in which a video man- 35 
ager 101 and video title sets 102 as shown in FIG. 4 are 
stored may be loaded into a reproducing apparatus 450, 
from whose system CPU section 50 the encoded data is 
taken out digitally and transmitted by a modulator/trans- 
mitter 460 to the users or the cable subscribers by radio 40 
or via a cable. Furthermore, the encoding system 490 
and format system shown in FIGS. 63 and 66 may 
encode and format the data, respectively, on the pro- 
vider side, such as a broadcasting station, and the for- 
matted data may be transmitted by the 45 
modulator/transmitter 460 to the users or the cable sub- 
scribers by radio or via cables. In such a communication 
system, the information in the video manager 101 is 
modulated at the modulator/transmitter 460 and then 
supplied to or is directly supplied to the users free of so 
charge. When a user is interested in the title, the modu- 
lator/transmitter 460 transmits the title set 102 at the 
user*s or subscriber's request by radio or via a cable. 
Under the control of the video manager 101, the video 
title set information 140 is first transferred and then the 55 
title video object 141 in the video title set reproduced 
according to the title set information 140 is transferred. 
At this time, if necessary, the video title set menu video 
object 141 is also transmitted. The transferred data is 



received by a receiver/demodulator 480 on the user 
side and is processed as decoded data at the system 
CPU section 50 of the reproducing apparatus on the 
user or subscriber side of FIG. 1 in the same manner as 
in the above-described reproducing process, whereby 
the video data is reproduced. 

As described above, the recording medium accord- 
ing to the present invention is able to forcibly reproduce 
the sub-picture in accordance with the state of repro- 
duction. Thus, video data can be provided with which a 
problem in that a user cannot understand the story can 
be prevented. 

Claims 

1. A recording medium having a data pack sequence 
(85) in which sub-picture data packs (90) and one 
or both of video and audio data packs (88 f 90, 91) 
are arranged, said recording medium characterized 
by comprising: 

a sub-picture data unit (230) composed of a 
plurality of sub-picture packs (90), wherein 
control information (233) for forcibly controlling 
reproduction of sub-picture data (232) is 
described in said sub-picture data unit (230). 

2. A recording medium according to claim 1, charac- 
terized in that sub-picture data (232) is run-length- 
compressed and stored in said pack (90). 

3. A recording medium according to claim 1, charac- 
terized in that control information (232) in said sub- 
picture data unit (230) includes time information for 
reproducing said sub-picture data unit (230). 

4. A recording medium according to claim 1, charac- 
terized in that control information (233) in said sub- 
picture data unit (230) includes a command (234) 
for controlling display of said sub-picture data unit 
(230). 

5. A recording medium according to claim 4, charac- 
terized in that said display command (234) includes 
a forcible picture output command for forcibly caus- 
ing image data to appear. 

6. A recording medium according to claim 4, charac- 
terized in that said display command (234) includes 
a reproduction start command for setting timing at 
which reproduction of image data is started. 

7. A recording medium according to claim 4, charac- 
terized in that said display command (234) includes 
a reproduction interruption command for setting 
timing at which reproduction of image data is inter- 
rupted. 

8. A recording medium according to claim 4, charac- 
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terized in that said display command (234) includes 
a completion command for completing a set com- 
mand. 

9. A recording medium according to claim 1 , charac- 
terized in that said sub-picture pack sequence 
includes sub-picture data streams in a plurality of 
different languages. 

10. A recording medium according to claim 1, charac- 
terized in that said audio pack sequence (91) 
includes audio data streams in a plurality of differ- 
ent languages. 

1 1 . A recording medium according to claim 1 , charac- 
terized by further comprising menu data for select- 
ing the sub-picture. 

1 2. A reproducing method structured such that a sub- 
picture is reproduced from a recording medium (10) 
having a data pack sequence (85) in which sub-pic- 
ture data packs (90) and one or both of video and 
audio data packs (88, 90, 91) are arranged, said 
reproducing method characterized by comprising 
the steps of: 

acquiring a sub-picture data unit (230) com- 
posed of a plurality of sub-picture packs (90) 
from said recording medium (10); and 
acquiring control information (233) for forcibly 
controlling reproduction of sub-picture data 
(232) described in said sub-picture data unit 
(230) to control output of pixel data in said sub- 
picture data unit (230) in accordance with 
acquired control information (233). 

13. A reproducing method according to claim 12, char- 
acterized in that said output control step includes a 
step of elongating sub-picture data (232) run- 
length-compressed and stored in said pack (90) to 
decode sub-picture data (232) into pixel data. 

14. A reproducing method according to claim 12, char- 
acterized in that control information (233) in said 
sub-picture data unit (230) includes time informa- 
tion for reproducing said sub-picture data unit 
(230), and said output control step is performed 
such that pixel data is output in accordance with 
time information. 

15. A reproducing method according to claim 12, char- 
acterized in that control information (233) in said 
sub-picture data unit (230) includes a command to 
control display of said sub-picture data unit (230), 
and said output control step is structured to control 
output. 

16. A reproducing method according to claim 15, char- 
acterized in that said display command (234) 



includes a forcible picture output command for forci- 
bly causing image data to appear, and said output 
control step is structured to output pixel data in 
accordance with said forcible picture output com- 
5 mand. 

17. A reproducing method according to claim 15, char- 
acterized in that said display command (234) 
includes a reproduction start command for setting 
10 timing at which reproduction of image data is 
started, and said output control step is structured to 
output pixel data in accordance with said reproduc- 
tion start command. 

is 18. A reproducing method according to claim 15, char- 
acterized in that said display command (234) 
includes a reproduction interruption command for 
setting timing at which reproduction of image data 
is interrupted, and said output control step is struc- 

20 tured to interrupt output of pixel data in accordance 
with said reproduction interruption command. 

19. A reproducing method according to claim 15, char- 
acterized in that said display command (234) 

25 includes a completion command for completing a 
set command. 

20. A reproducing method according to claim 12, char- 
acterized in that said sub-picture pack sequence 

30 (85) includes sub-picture data streams in a plurality 
of different languages. 

21. A reproducing method according to claim 12, char- 
acterized in that said audio pack sequence includes 

35 audio data streams in a plurality of different lan- 
guages. 

22. A reproducing method according to claim 12, char- 
acterized by further comprising menu data for 

40 selecting the sub-picture. 

23. A reproducing apparatus for reproducing a sub-pic- 
ture from a recording medium (10) having a data 
pack sequence (85) in which sub-picture data 

45 packs (90) and one or both of video and audio data 
packs (88, 90, 91) are arranged, said reproducing 
apparatus comprising: 

means (30, 50, 52, 54, 56) for retrieving a sub- 
so picture data unit (230) composed of a plurality 
of sub-picture packs (90) from said recording 
medium (10); and 

means (62, 64) for retrieving control informa- 
tion (233) for controlling reproduction of sub- 
55 picture data described in said sub-picture data 

unit (230) to control output of pixel data in said 
sub-picture data unit (232) in accordance with 
retrieved control information (233). 
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24. A reproducing apparatus according to claim 23, 
characterized in that said output control means 
includes means for expanding sub-picture data 
(232) run-length compressed and stored in said 
pack (90) to decode sub-picture data into pixel data. 

25. A reproducing apparatus according to claim 23, 
characterized in that control information (232) in 
said sub-picture data unit (230) includes time infor- 
mation for reproducing said sub-picture data unit 
(230), and said output control means outputs pixel 
data in accordance with time information. 

26. A reproducing apparatus according to claim 23, 
characterized in that control information (232) in 
said sub-picture data unit (230) includes a com- 
mand (234) for controlling display of control infor- 
mation, and said output control means controls 
output in accordance with said display control com- 
mand (234). 

27. A reproducing apparatus according to claim 26, 
characterized in that said display command (234) 
includes a forcible picture output command for forci- 
bly causing image data to appear, and said output 
control means outputs pixel data in accordance 
with said forcible picture output command. 

28. A reproducing apparatus according to claim 26, 
characterized in that said display command (234) 
includes a reproduction start command for setting 
timing at which reproduction of image data is 
started, and said output control means outputs 
pixel data in accordance with said reproduction 
start command. 

29. A reproducing apparatus according to claim 26, 
characterized in that said display command (234) 
includes a reproduction interruption command for 
setting timing at which reproduction of image data 
is interrupted, and said output control means inter- 
rupt output of pixel data in accordance with said 
reproduction interruption command. 

30. A reproducing apparatus according to claim 26, 
characterized in that said display command (234) 
includes a completion command for completing a 
set command. 

31. A reproducing apparatus according to claim 23, 
characterized in that said sub-picture pack 
sequence (85) includes sub-picture data streams in 
a plurality of different languages. 

32. A reproducing apparatus according to claim 23, 
characterized in that said audio pack sequence (85) 
includes audio data streams in a plurality of differ- 
ent languages. 



33. A reproducing apparatus according to claim 23, 
characterized by further comprising menu data for 
selecting the sub-picture. 

s 34. A recording method structured such that a data 
pack sequence (85) in which sub-picture data 
packs (90) and one or both of video and audio data 
packs (88, 90, 91) are arranged is recorded on a 
recording medium (10), said recording method 

10 characterized by comprising the steps of: 

forming a sub-picture data unit (230) by a plu- 
rality of sub-picture packs (90); and 
describing control information for forcibly con- 
15 trolling reproduction of sub-picture data (232) 

in said sub-picture data unit (230). 

35. A recording method according to claim 34, charac- 
terized by further comprising a step of run-length- 

20 compressing sub-picture data to store sub-picture 
data in said pack (90). 

36. A recording method according to claim 34, charac- 
terized in that control information (233) in said sub- 

25 picture data unit (230) includes time information for 
reproducing said sub-picture data unit (230). 

37. A recording method according to claim 34, charac- 
terized in that control information (233) in said sub- 

30 picture data unit (230) includes a command for con- 
trolling display of control information. 

38. A recording method according to claim 37, charac- 
terized in that said display command (234) includes 

35 a forcible picture output command for forcibly caus- 
ing image data to appear. 

39. A recording method according to claim 37, charac- 
terized in that said display command (234) includes 

40 a reproduction start command for setting timing at 
which reproduction of image data is started. 

40. A recording method according to claim 37, charac- 
terized in that said display command (234) includes 

45 a reproduction interruption command for setting 
timing at which reproduction of image data is inter- 
rupted. 

41. A recording method according to claim 37, charac- 
so terized in that said display command (234) includes 

a completion command for completing a set com- 
mand. 

42. A recording method according to claim 34. charac- 
55 terized in that said sub-picture pack sequence (85) 

includes sub-picture data streams in a plurality of 
different languages. 

43. A recording method according to claim 34, charac- 
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terized in that said audio pack sequence includes 
audio data streams in a plurality of different lan- 
guages. 

44. A recording method according to claim 34, charac- 
terized by further comprising menu data for select- 
ing the sub-picture. 

45. A recording apparatus for recording, on a recording 
medium (10) having a data pack sequence (85) in 
which sub-picture data packs (90) and one or both 
of video and audio data packs (88, 90, 91) are 
arranged, said recording apparatus characterized 
by comprising: 

means (403, 408, 412) for forming a sub-pic- 
ture data unit (85) by a plurality of sub-picture 
packs (90); and 

means (405, 414. 416. 426, 428, 430, 432) for 
describing control information (232) for control- 
ling reproduction of sub-picture data (232) in 
said sub-picture data unit (85). 

46. A recording apparatus according to claim 45, char- 
acterized by further comprising means for run- 
length-compressing sub-picture data (232) to store 
sub-picture data (232) in said pack (85). 

47. A recording apparatus according to claim 45, char- 
acterized in that control information (232) in said 
sub-picture data unit (85) includes time information 
for reproducing said sub-picture data unit (85). 

48. A recording apparatus according to claim 45, char- 
acterized in that control information (232) in said 
sub-picture data unit (85) includes a command for 
controlling display of control information. 

49. A recording apparatus according to claim 48, char- 
acterized in that said display command (234) 
includes a forcible picture output command for forci- 
bly causing image data to appear. 

50. A recording apparatus according to claim 48, char- 
acterized in that said display command (234) 
includes a reproduction start command for setting 
timing at which reproduction of image data is 
started. 

51 . A recording apparatus according to claim 48, char- 
acterized in that said display command (234) 
includes a reproduction interruption command for 
setting timing at which reproduction of image data 
is interrupted. 

52. A recording apparatus according to claim 48, char- 
acterized in that said display command (234) 
includes a completion command for completing a 
set command. 



53. A recording apparatus according to claim 48, char- 
acterized in that said sub-picture pack sequence 
(85) includes sub-picture data streams in a plurality 
of different languages. 

5 

54. A recording apparatus according to claim 48, char- 
acterized in that said audio pack sequence includes 
audio data streams in a plurality of different lan- 
guages. 

10 

55. A recording apparatus according to claim 48, char- 
acterized by further comprising menu data for 
selecting the sub-picture. 

15 56. A communication apparatus for transferring a data 
pack sequence (85) in which sub-picture data 
packs (90) and one or both of video and audio data 
packs (88, 90, 91) are arranged, said communica- 
tion apparatus characterized by comprising: 

20 

means (450, 490, 460, 470) for transferring, to 
said recording medium (10), a sub-picture data 
unit (85) composed of a plurality of sub-picture 
packs (90), said means (450, 490, 460. 470) 

25 being transferring means (470) for transferring 

control information (233) for controlling repro- 
duction of sub-picture data (232) to be 
described in said sub-picture data unit (85) and 
controlling output of pixel data in said sub-pic- 

30 ture data unit (85) in accordance with trans- 

ferred control information (233). 

57. A communication apparatus according to claim 56, 
characterized in that said transferring means (450, 

35 490, 460, 470) transfers sub-picture data (232) run- 
length-compressed and stored in said pack (90). 

58. A communication apparatus according to claim 56, 
characterized in that control information (233) in 

40 said sub-picture data unit (85) includes time infor- 
mation for reproducing said sub-picture data unit. 

59. A communication apparatus according to claim 56, 
characterized in that control information (233) in 

45 said sub-picture data unit (85) includes a command 
(234) for controlling display of control information. 

60. A communication apparatus according to claim 56, 
characterized in that said display command (234) 

so includes a forcibl e picture output command for forci - 
bly causing image data to appear. 

61. A communication apparatus according to claim 56, 
characterized in that said display command (234) 

55 includes a reproduction start command for setting 
timing at which reproduction of image data is 
started. 

62. A communication apparatus according to claim 61, 



55 



25 
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characterized in that said display command (234) 
includes a reproduction interruption command for 
setting timing at which reproduction of image data 
is interrupted. 

5 

63. A communication apparatus according to claim 61, 
characterized in that said display command (234) 
includes a completion command for completing a 
set command. 

10 

64. A communication apparatus according to claim 56, 
characterized in that said sub-picture pack 
sequence (85) includes sub-picture data streams in 
a plurality of different languages. 

15 

65. A communication apparatus according to claim 56, 
characterized in that said audio pack sequence 
includes audio data streams in a plurality of differ- 
ent languages. 

20 

66. A communication apparatus according to claim 56, 
characterized by further comprising menu data for 
selecting the sub-picture. 

25 
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40 



45 
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